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ABSTRACT 


The  basic  problem  considered  is  the  design  of  an  optimal 
control  for  a  system  subjected  to  disturbances.  Although  deterministic 
disturbances  are  discussed,  the  majority  of  the  vork  and  the  three 
exanqples  deal  with  random  or  stochastic  disturbances.  The  principal 
contention  of  this  work  is  that  one  cannot  determine  an  "optimal" 
control  for  a  system  without  optlmining  a  performance  criterion  which 
•  ^  u  measure  of  th**  nerformance  of  the  entire  system.  The  Max -Ranking 
Performance  Criterion  which  is  developed  iicrc  hc"  the  ~cpo..,llity  for 
considering  a  wide  variety  of  system  variables.  The  use  of  this  criterion 
does  not  depend  upon  any  knowledge  of  the  system  interactions;  the 
designer  need  only  present  his  specifications  for  the  system  operation 
in  the  form  of  a  ranking  array. 

The  nonlinear  systems  studied  here  are  analyzed  using  a 
statistically  eqtiivalent  linear  system.  This  follows  the  work  of  Kazakov 
and  Booton. 

Random  search  techniques  are  i  jed  x^lth  the  Max -Ranking  Criterion 
and  the  linearized  analysis  approach  to  produce  the  optimum  system.  A 
simple,  but  efficient  method  of  random  search  is  developed.  Restilts  are 
obtained  to  show  the  expected  rate  of  convergence  of  this  type  of  search 
for  simple  functions. 

These  methods  are  then  applied  to  three  systems  which  are  sub¬ 
jected  to  random  dl8t\irbances ;  the  design  of  a  three -'parameter  control 
for  a  third -order  system;  the  design  of  a  f ive-paramet er  control  for  the 
roll  control  of  a  submarine;  and  the  design  of  a  nine -parameter  control 
for  the  coupled  pitch-heave  control  of  a  submarine. 
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Nomenclatiire 


The  general  nomenclature  used  thi'oughout  thiJ>  work  ia  listed 
here.  The  particular  usage,  incl’uding  subscripting,  is  defined  where 
it  is  used. 


E(  ) 

h(  ) 

U 

K 

Si 


m 


n 


N 


c 


P 

R(t) 


expected  or  mean  value 

system  impulse  response 

performance  index 

control  parameter 

statistically  equivalent 
linear  gain 

ex3»nent  in  the  exponential 
search  probability 

number  of  search  parameters 

numbe"  of  random  choices 

probability  density 
autocorrelation  function 


S^(aj) 

X,  r 


a 


0) 


Laplace  Transform  Operator 
power  spectral  density 
system  variables 
variance 
frecaency 
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1 . 0  Introduction 


One  of  the  principal  objectives  of  a  wide  variety  of  control 
systems  is  to  minimize  the  detrimental  effects  which  external  disturbances 
have  upon  the  overall  performance  of  the  system.  In  many  Instances,  it 
is  sxiffioient  to  design  a  control  which  causes  the  system  to  recover  in 
some  optimal  fashion  from  a  step  or  impulse  or  other  deterministic  dis¬ 
turbance.  An  example  of  this  is  the  design  of  a  control  for  a  heat 
exchanger  which  is  subjected  to  sudden  large  changes  in  heat  load.  In 
other  cases  the  control  must  resjx)nd  optimally  to  dlstvurbances  of  a 
continuous,  long-term,  random  nature.  An  example  of  this  is  the  control 
of  the  motion  of  a  ship  in  a  random  sea. 

This  work  deals  primarily  with  the  design  of  optimal  controls 
for  systems  subjected  to  this  latter  type  of  continuous,  stochastic 
disturbance.  Some  aspects  of  this  work  are  equally  applicable  to  both 
types  of  disturbances.  Where  this  occurs,  suggestions  for  the  application 
will  be  discussed. 

The  general  problem  of  optimal  control  is  approached  here  from 
an  overall  system  point -of -view.  It  is  the  principal  contention  of  this 
work  that  in  order  to  truly  speak  of  the  "optimal  control"  of  a  system, 
it  is  necessary  to  optimize  a  performance  criterion  which  d^ls  in  some 
manner  with  the  performance  of  the  entire  system.  This  approach  is 
quite  obvious  and  straightforward  in  theory;  the  difficulty  lies  in 
defining  a  performance  criterion  which  is  capable  of  describing  the 
performance  of  the  entire  system.  It  is  felt  that  the  Multiple-Parameter, 
Max-Ranking  Criterion  introduced  in  Chapter  2  is  least  a  step  toward 
this  goal. 

S^fAvaJabfe  copy 
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The  selection  of  an  optlzoal  control  It  determined  throng  a 
three-step  process: 

1.  the  choice  of  an  optimization  criterion, 

2.  the  choice  of  the  nathonatlcal  model  and  analytical 
approach,  and 

3.  the  choice  of  an  optimization  technique. 

These  three  operations  are  treated  In  Chapters  2,  3,  and  4  respectively. 

In  Chapter  5»  "the  methods  arrived  at  in  the  previous  three 
chapters  are  applied  to  three  practical  problems.  In  the  first  exarple, 
a  relapively  slnplei  three-parameter,  nonlinear  control  is  designed  for 
a  second  order  system  subjected  to  a  random  input  and  the  results  are 
compared  vlth  other  methods.  In  the  second,  a  five -parameter,  non¬ 
linear  controller  Is  designed  for  ttie  roll  control  of  a  submarine  sub¬ 
jected  to  a  random  sea.  Finally,  a  nine-parameter,  nonlinear  controller 
Is  chosen  for  the  coupled  pitch-heave  control  of  a  submarine  in  a  randcwn 
sea. 

It  is  pi-esumed  that  the  reader  has  a  basic  knovledge  of  the 
response  of  linear  systems  to  random  or  stochastic  input  signals. 

(1  2 

Many  good  texts'  *  '  are  available  in  this  area  and  no  attenpt  vlll 

oe  made  to  dt^llcate  this  Information  In  this  publlcetion. 
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2.0  Optiadzatlon  Criterion 


One  of  the  noat  liqiortant  steps  In  any  optimization  process 
is  the  choice  of  the  optiadzatlon  or  perfonaance  criterion.  It  can 
be  safely  stated  that  if  the  analytical  and  optladzation  techniques  are 
adequate,  the  choice  of  the  optiadzatlon  criterion  will  coaqpletely 
determine  the  final  system. 

This  nay  appear  to  be  belabosring  an  obvious  point,  bovever 
one  need  not  look  veiry  deeply  into  the  literature  in  the  field  of 
optimal  control  to  see  that  all  too  many  good  analytical  efforts  are 
performed  on  the  basis  of  grossly  oversinrplifled  performance  criteria. 
The  reason  for  this  is  partly  historical  and  partially  due  to  mathe¬ 
matical  expediency,  as  the  folloving  sections  show. 

2.1  Performance  Criteria  for  Randomly  Disturbed  Systems 

Vhen  a  system  is  disturbed  by  a  random  process,  the  exact 
time  history  or  the  system  output  cannot  be  predicted.  However,  since 
SOTie  statistical  information  is  known  about  the  input  disttirbance,  it 
is  usually  possible  to  predict  certain  statistical  properties  of  the 
output.  The  two  most  coBoon  and  most  easily  determined  statistical 
quantities  are  the  mean  and  the  variance  (or  mean  square).  For  non- 
Qausslan  randcma  processes,  hlt,^ier  order  moments  may  be  of  interest. 

For  Qatissian  (or  normal)  probability  distributions,  tile  s»an  and  the 
variance  conpletely  describe  the  distribution.  Since  this  work  t. 
solely  with  systems  sxibjected  to  zero-mean  Qanssian  disturbances,  and 
since  an  analytical  technique  baaed  Mpon  statistically  equivalent 
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linearization  ■will  be  enployed,  the  variance  vill  provide  aix  effective 
statistical  measure  of  the  system  variables  for  the  cases  studied  here. 

2,1.1  Mean  Square  Krror  Performance  Criteria 

In  the  early  19^0’s,  there  existed  In  the  field  of  conmm- 
ication  the  problem  of  extracting  as  much  Information  as  possible  from 
a  cwnDunlcations  signal  vhlch  had  been  distorted  by  noise.  Wiener' 
prcposed  a  method  for  optimizing  this  process.  His  procedure  vas 
based  upon  the  »  of  the  so-called  '’minimum  mean  square  error"  perfor¬ 
mance  criterion  (see  Pigure  l).  Weiner  defined  an  error  vhich  vas  the 
difference  between  the  actual  out^nzt  signal  and  the  desired  output 
signal  (which  is, for  tills  particular  case,  the  original  signal).  He 
proposed  that  the  optimum  system  is  that  system  vhlch  has  the  minimum 
value  of  the  mean  square  error. 

Two  questions  generally  arise  concerning  the  wisdom  of  the 
choice  of  this  particular  performance  criterion. 

1.  Why  was  a  statistical  measure  of  the  error  the  only 
system  variable  chosen? 

2.  Is  this  the  best  statistical  measure  that  can  be 
chosen? 

The  answer  to  the  first  question  is  quite  slnple.  !nie  only 
objective  that  was  considered  important  in  this  phase  of  the  commun¬ 
ication  system  design  was  to  get  as  much  information  as  possible  out  of 
a  mixture  of  signal  and  noise.  The  error  signal  defined  above  is  as 
effective  a  measure  of  the  efficiency  ^f  this  process  as  can  be  found. 
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The  ansver  to  the  second  question  took  somewhat  longer  to 
he  formulated.  Initially,  a  number  of  people  suggested  that  other 
nonlinear  statistical  functions  of  the  error  woiil'^  be  better.  However, 
in  1958  Shernan'"^^  showed  that  most  of  these  more  conqjlicated  perfor¬ 
mance  criteria  would  produce  a  filter  identical  to  that  determined 
using  Wiener’s  method.  Sherman  stated: 

"Thus,  in  the  case  of  a  Gaussian  process, . 

the  solution  of  the  Wiener  integral  equation  (the 
predictor  which  minimizes  E  (e^))  also  automatically 
minimi zee  S  £9(0)^  where  9  obeys  the  relationships 

9(e)  =  9(-e)  ^  0; 

eg  >  ei  ^  0  -•  9  (eg)  >  9  (e^j^).” 

(E  (x)  is  defined  as  the  expected  (or  mean)  value  of  x. ) 

Ibus  we  see  that  for  this  particular  problem  the  minimum 
mean  square  error  performance  criterion  was  a  good  choice. 

Wiener’s  xise  of  the  minimum  mean  square  error  performance 
criteria  was  carried  over  into  the  field  of  atitomatlc  control  by 
Phillips^"  and  Hall^®\  Phillips  suggested  a  method  for  determining 
the  coefficients  of  a  linear  control  system  so  as  to  produce  a  ndnlmum 
value  of  the  mean  square  error.  He  developed  a  means  to  Integrate 
the  general  polynomial  form  of  the  power  spectral  density  in  order  to 
give  the  mean  square  value  in  closed  form.  This  allows  one  to  engjloy 
conventional  methods  of  calculus  to  obtain  a  miniiiium. 

In  order  to  consider  more  effectively  what  the  variovis  per¬ 
formance  criteria  mean  in  terms  of  actual  control  systems,  let  us  consider 
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the  control  ayatea  of  Figure  2.  This  control  Is  iised  to  position  • 
second  order  system  soihjected  to  a  randoa  disturbance.  The  controller 
utilizes  displacement  error  (e)  feedback.  The  control  force  (F)  Is  con¬ 
strained  to  vlthln  given  limits  F^^),  but  all  other  cosqponents  are 
considered  to  be  linear.  (The  Laplace  Transform  Operator,  s  ,  Is 
used  to  denote  differentiation  with  respect  w  time.) 

Let  tis  flr^t  consider  a  mlniraia  mean  sqpar*  displacement 
error  (a^)  performance  criterion.  It  can  be  readily  shorn  that  the 
mean  square  displacement  error  is  zero  (and  obvioxisly  a  mint  mum)  if 
IL  and  F  are  infinite.  This  is  of  ve./  little  practical  Interest, 

QbkX 

since  it  Implies  infinite  control  forces. 

To  bypass  this  dlfflcijlty,  a  nxamber  of  people  hare  suggested 

restricting  the  value  of  F _ to  practical  values.  Mow,  a  slnlKHsa 

nauc 

value  of  Og  is  produced  by  an  infinite  value  of  I^.  This  recjulred  a 
"bang-bang"  or  infinite  9tin,  aapHtude-liolted  comtroller.  For  the 
control  of  Figure  2,  it  also  inq^les  infinite  control  power.  This 
practical  "detail"  can  be  circuanrented  by  placing  a  constraint  on  the 
maximum  allowable  control  power.  Howerer,  by  this  time  It  Is  obvloua 
that  tue  basic  design  decisions  sxich  aa  warimMS  control  force  and  max¬ 
imum  control  power  are  being  made  vithout  the  benefit  of  the  optiadi^a- 
tlon  process.  Tike  result  of  this  is  that  one  or  more  qptiana  coeffic¬ 
ients  are  determined  for  a  control  system  vtaose  major  oospoasats  ara 
already  specified.  There  is  no  guarantee  that  the  entire  cuntroL*  eystem 
is  optlsml.  For  this  type  nt  problem,  ve  eonelude  that  a  mlnlmiMi  mean 
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square  error  perfonsBace  criterion  1»  not  sufficiently  general  to  be  of 
much  assistance  In  the  detersdnatlon  of  a  practical  optlml  oootrol 
design. 

A  mBrt>er  of  other  criteria  which  utlllac  aoaa  fiaaetloKt  of  the 
error  hare  bean  suggested.  References  9«  10*  11*  and  12  eorar  aany  of 
these  criteria.  They  will  not  be  discussed  here*  slxwa  thsgr  *11  behawe 
slxnllarly  to  the  attnlonsn  aeao  square  error  criterion.  In  Met*  for 

fll ) 

linear  systems  subjected  to  Qaviaslan  dlsturbaacsa*  It  baa  basn  shown' 
that  the  minialtatlon  of  the  mean  square  er.'or  la  eq^lrmlsnt  to  tha 
minimization  of  many  of  these  other  criteria  also. 

2.1.2  MultlplS'Mraaieter  Vel^ttlng  Criteria 

Cne  step  toward  the  esqiloyBent  of  the  systsLa  concept  In 

(yl 

optl&l ration  la  a  direct  extension  of  the  work  of  ThllUps''^.  Here* 
the  mean  square  error  perfcroance  criterion  la  replaced  by  one  which 
Includes  more  of  the  syeten  characterletlce.  tor  example*  referring 
again  to  the  control  of  figure  2,  It  Is  possible  to  alalsd.se  tha 
function  J,  where* 


T  2  2  ^  2  ^  2  N 

The  mran  square  values  of  acceleration*  velocity*  dlsplaceaent  error 

2  2  2 

and  control  force  are  respectively  represented  by  O^*  gad 
2 

o^.  The  terms  o^*  012*  *3*  weighting  panaatara  which 

can  be  constants  or  functions  of  their  aasoelatad  asaa  square  ayatea 
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variables.  If  tihe  a’s  are  constants  and  the  system  is  linear,  J  can 
be  mlnioilzed  \iaijQg  standard  methods  of  calcxilixs.  It  can  be  s'aovn  that 


Increasing  and  tends  to  decrease  Oy,  and  vhile 

increasing  Cy  Tims  If  all  a's  are  positive,  non -zero  and  finite,  a 
wiwiitBitn  value  of  J  vlll  exist  vhere  oy,  cr^  and  are  finite 

and  ncm-zero.  This, at  least,  is  a  step  la  the  rl^t  direction. 

Uhfortunately,  the  process  of  choosing  valties  for  the  four 
o's  is  quite  difficult.  An  intelligent  choice  of  these  vei^ting  para¬ 
meters  must  he  based  upon  a  thorou^^  knovledge  of  the  system  behavior, 
including  the  various  interactions  within  the  system.  This  is  some¬ 
times  possible  for  slnqjle  systems,  but  it  becomes  far  too  difficult  as 
the  conqplexity  is  Increased  only  subtly. 

An  alternate  approach  is  the  following: 

1. -  make  the  best  possible  estimate  of  the 

wei^ting  parameters; 

2.  determine  the  values  of  the  control  para¬ 
meters  which  minimize  this  value  of  J; 

3.  determine  the  mean  square  values  of  the 
necessary  system  variables; 

4.  revise  the  weighting  parameters  to  place 
more  enqphasis  on  those  system  yarlableo  yhoee 
mean  square  values  are  too  hi^; 

5.  repeat  steps  2  nhrou^  4  until  a  satisfactory 
system  b^iavlor  Is  obtained. 
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This  Is  certainly  not  a  desirable  eppzxiach,  but  It  Is  shout 
the  only  one  which  will  give  satisfactory  results  with  this  aethod  oX 
loultlple -parameter  vel^ditlng  when  little  is  known  about  the  sywtesi 
behavior  ahead  of  time. 

2.1.3  newton's  Multiple  Parameter  Criteria 

Hevton^  ^  ^  recognized  the  llaitatlons  of  the  oliiiflBS  aean 
square  error  and  s\iggeBted  that  the  mean  square  error  should  be  min- 
luized  while  slxaxitaneoxisly  limiting  tha  msaa  square  values  of  other 
Important  system  variables  (such  as  control  forces,  etc.}.  This 
requires  introducing  one  or  more  lAgraage  Multipliers.  If  the  con¬ 
trol  coni Igurat Ion  Is  known,  the  n  control  parameters  can  be 
decemlned  from  the  n  equations  of  the  fom, 

m 

J-1 

where  a^(K^. .  .X^ . .  .K^)  Is  the  mean  square  error  expressed  as  a  function 
of  the  n  control  parameters  (X^...X^...i:^),  Xl*  Lagrange  Multi¬ 
plier  and  the  m  constraints  are  expressed  by  the  m  functions, 
qpj(K^. .  .K^ . .  .K^)  »  0.  This,  however.  Is  exactly  equivalent  to  the 

multiple -parameter,  weighting  criterion  (equation  l)  with  equal  to 
unity.  The  remaining  wel^tlzig  parameters  becosw  constants  equal  to  the 
Lagrange  Multipliers  of  equation  (2).  Haas,  this  method  has  the  aaaw 
deficiencies  as  the  multlple-paraswter  weighting  criterion. 


Nevton  t;ent  beyond  this  point  and  chose  to  leave  the  con¬ 
trol  configuration  unspecified.  He  used  Calculus  of  Variations 
techniques  with  the  Lagraurige  Multipliers  to  find  the  optimum  linear 
control  function.  This  aj^roach  is  certainly  superior  to  any  methods 
thxis  far  dlscxissed,  since  it  determines  both  the  control  configuration 
and  the  control  perimeters.  However,  it  does  not  solve  the  problem  of 
choosing  the  weighing  functions  or  Lagrange  Multipliers. 

2.1.4  Multiple  Parameter  Ma.- -Ranking  Criterion 

The  method  described  in  this  section  is  based  upon  the  employ¬ 
ment  cf  a  ranking  array.  The  essential  factor  1  .re  is  that  each  system 
attribute  which  is  to  be  considered  in  the  optimize t ion  is  rated  against 
an  absolute  scale  of  desirability.  An  exanqple  of  a  possible  ranking  array 
for  the  system  of  Figure  2  is  shown  below. 


Desirability 

J(i) 

(i=l) 

cr 

A 

(ft/sec^) 

(i-2) 

(ft/sec ) 

(i=3) 

O’ 

e 

(ft) 

(Ibf) 

Most  Desirable 

0 

0 

0 

0 

0 

i 

3 

8 

0.1 

10 

2 

3 

10 

20 

3 

4 

12 

0.3 

40 

Least  Dfiirable 

k 

8 

16 

0.4 

8o 

Table  1 

Sample  Ranking  Array 
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The  oo8t  desirmbl*  values  of  the  root  mean,  squiure  (r.a.s. ) 
accelpratlon,  velocity,  displacement  error,  and  cootrol  force  are  all 
zero.  This  is,  of  course,  an  inpossible  goal  as  long  as  there  Is  aoy 
distorbarce  force.  The  final  rov  of  the  table  can  be  readily  filled 
in  also.  This  rov  represents  the  »nax1  ana  value  of  each  of  the  system 
variables  which  Is  acceptable. 

The  resmlnder  of  the  table  Is  constructed  vlth  as  aaiiy  rows 
ac  the  designer  feels  are  necessary  to  adequately  describe  the  various 
levels  of  desirability  of  the  system  response.  The  only  extenal  restric¬ 
tion  placed  on  the  table's  construction  Is  that  each  coluan  sust  be 
either  monotonlcally  non-lncreaslng  or  isonotonlcally  non -decreasing. 

Each  r.m.s.  value  Is  chosen  to  be  as  desirable  aa  all  othar  values  in 

the  same  row,  Fijr  escaaq)!’,  consider  rov  3  (J(l)  «  2).  A  value  of 
2 

9^  •  3  ft/sec  is  considered  as  being  aa  deslxab^e  an  end  result  aa 
Oy  «  10  ft/sec,  and  -  0.2  ft.,  and  •  20  Ib^. 

The  construction  of  this  ranJelng  arxay  should  ba  carried  out 
with  a  great  deal  of  thought.  The  results  of  the  entire  optlsdsation 
study  will  depend  upon  the  values  selected  at  this  tims.  Ih  ordar  to 
construct  the  ranking  array,  the  desl^ier  oust  have  a  good  appreciation 
of  the  system  capabilities  and  requirements.  However,  he  need  not  ba 
familiar  vlth  hov  the  various  s^’stem  variables  are  related  to  each  othar 
and  to  each  of  the  several  control  parameters.  This  function  is  takaa 
care  of  automatically  by  the  analytical  and  optiaizatiott  atodiaa  Uhioh 
are  conducted  in  the  following  phases  of  this  work* 


Once  the  ranking  array  is  set  up,  it  can  be  applied  in  a 
strai^tforward  and  sin^ile  manner.  The  first  step  is  to  assign  values 
to  each  J(i)  for  any  given  set  of  system  variables.  This  can  be 
accon5>lished  by  any  interpolation  scheme  vhich  the  designer  desires 
to  employ . 

As  an  example,  let  us  refer  back  to  Table  1.  Lot  us  suppose 
that  for  a  given  system  vith  a  given  disturbance  a  certain  set  cf  con¬ 
trol  parameters  gives  the  following  resrilts: 

=  4.0  ft/sec^ 

ay  •  4.0  ft /sec 

a  =  0.15  ft 

e 

Op  ■  20.0  Ib^ 

Linear  interpolation  in  Table  1  gives  the  following  values  of  each  J(i): 

2 

j(l)  =  3*0  (corresponding  to  =  4.0  ft/sec  ) 

j(2)  »  0.5  (correspOTdlng  to  Oy  =  4.0  ft/sec) 

j(3)  =  1*5  (corresponding  to  =  0.15  ft) 

j(4)  -  2.0  (corresponding  to  Op  =  20.0  Ib^) 

This  essentially  established  the  desirability  (for  this  particular  case) 
of  each  of  the  four  resulting  system  variables.  Two  different  approaches 
were  taken  in  an  attempt  at  assigning  an  overall  system  desirability 
based  upon  these  separate  values  of  the  individual  j(i)'s. 
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•nie  first  method  defines  the  overall  systen  desirability 
as  the.  average  desirability  of  the  resulting  Indivldua]  system  variables. 
For  the  particular  example  being  considered,  this  gives: 

4 

^  ^  J(l)  »  K3-0  +  0.5  +  1.5  +  2.0)  -  1.75 
i-1 

Tnls  method  la  exactly  equivalent  to  the  multiple-parameter  velgbtlng 
criterion  (equation  (l))  vhose  velgfctlng  parameters  a*-e  functions  leter- 
mlnsd  by  the  ranking  array.  This  method  has  only  one  advantage  over  the 
weighting  method,  a  methodology  for  determining  the  weighting  functions. 
The  principal  disadvantage  Is  that  there  Is  an  Implicit  weighting  between 
the  columns  of  the  ranking  array.  To  Illustrate  this,  consider  the 
system  of  Figure  2,  where  increasing  will  cause  an  Increase  In  Oj 

while  decreasing  Oy-and  The  ndJiima  value  of  the  system 
desirability  (j  )  based  upon  this  averaging  method  would  be  one  which 

B 

produced  low  values  of  J(l),  J(2),  and  j(3)  at  the  expense  of  hl|^er 
values  of  J(4). 

A  much  better  method  Is  one  which  equates  the  overall  syatem 
desirability  with  the  value  of  J(l)  corresponding  tc  the  least  desir¬ 
able  of  the  resulting  Individual  attributes  of  the  system.  This,  in 
effect,  states  that  the  system  is  no  more  desirable  than  Its  least 
desirable  attribute.  This  method  has  been  termed  Nax-Banklag.  The 
Max-Ranking  measure  of  system  desirability  (j^^)  Is  defined  slsqily  as: 


15 


Jw  =  r^ci)! 

M  L  -1 

Thus,  for  the  exanrole  being  used  here,  J.,  is, 

-  [j(l)  =  3.0;  J(2)  =  0.5;  J(3)  =  1-5;  J(^)  =  2.0]^^  . 
or 

-  J(l)  «  3.0 

The  criterion  of  optitnality  is  that  J  should  be  minimized.  This  tends 

M 

to  produce  a  final  system  vith  tvo  or  sometimes  more  of  the  values  of 
the  individual  j(i)'8  being  equal. 

The  Max-Ranking  method  has  several  advantages  over  other  per¬ 
formance  criteria.  First,  the  desired  response  of  the  various  system 
variables  can  be  specified  in  a  form  vhich  is  familiar  to  the  designer. 
This  is  simply  because  the  designer  vill  (or  should)  have  an  avareness 
of  vhat  value  of  r.m.s.  displacement  error  or  acceleration  or  control 
force  would  be  considered  good  or  poor  for  his  particular  application. 

Secondly,  there  is  no  restriction  on  the  number  of  system 
variables  which  can  be  considered  in  the  ranking  array.  Any  variables 
included  in  iae  ranking  array  wh^ch  uo  not  turn  out  to  limit  the  final 
design  are  automatically  excluded  'n  ine  optimization. 

For  some  types  of  optimi/.eoion  techniques,  the  computation 
time  can  be  reduced  compared  to  so-me  other  multiple  parameter  methods . 
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This  Is  because  each  individual  J(i)  can  be  compared  to  the  prerlous 
mlninium  value.  As  soon  as  a  value  of  J(l)  is  found  which  exceeds  the 
previous  niiniraijn.  the  control  parameter  set  can  be  dlacaixied.  There 
is  no  reason  to  calciilate  all  the  remaining  values  as  would  be  required 
for  a  multiple -parameter  wei^^tlng  criterion. 

The  Max -Ranking  method  has  one  disadvantage  for  small  slnqple 
systems.  Because  of  the  possible  nonlinearity  of  the  ranking  array  and 
the  Inherent  nonlinearity  of  the  maximum  selection,  it  is  almost  always 
Impossible  to  obtain  a  closed-form  algebraic  solution  for  J^.  This, 
coupled  with  the  fact  that  the  several  partial  derivatives  of  J..  taken 
at  the  minimum  point  are,  in  general,  discontinuous  usually  disallows 
any  way  of  minimi .:lng  based  upon  calculus.  The  discontinuities  in  the 

partial  derivatives  also  add  to  this  to  make  steepest  ascent  techniques 
quite  difflcxilt  to  apply. 

This,  at  first,  appears  to  be  a  severe  disadvantage.  However, 
optimization  techniques  based  upon  calculus  and  steepest  ascent  become 
ver;'  unwieldy  anyhow  as  one  attenQ>ts  to  optimize  large  order  systems 
which  have  several  control  parameters.  Chapter  4  deals  with  this  prob¬ 
lem  of  choosing  an  optimization  technique  and  reaches  the  conclusion 
that  for  larger  systems,  the  Max -Ranking  method  la  actually  sliiq)ler  to 
work  with  than  other  Multiple-Parameter  methods. 

The  Max-Ranking  method  Is  applied  In  each  of  the  exaaiples  In 
Chapter  5*  Some  additional  practical  guidance  on  the  use  of  this  method 
is  discussed  at  that  point. 


?  9  Performance  Criteria  for  Systems  with  Deterministic  Disturbances 

This  topic  will  only  be  dealt  with  briefly,  since  Gibson'  ’ 
(ik) 

emd  WolXovitch'  ^  have  already  covered  roost  of  the  standard  criteria 
quite  effectively.  What  will  be  discussed  is  the  fact  that  the  Multiple- 
Parameter,  Max-Banking  Method  can  also  be  applied  to  a  system  subjected 
to  deterndnistic  dlstxirbances . 

Let  Tis  consider  again  the  sinple  positioning  control  system 
of  Figure  2.  However,  this  time  we  will  assvune  that  the  disturbance  is 
deterministic  and  of  short  dttration.  (As  a  matter  of  fact,  the  system 
disturbance  could  be  a  step,  ranro  or  other  known  change  in  the  desired 
displacement.)  Some  meeisures  of  system  response  which  are  of  value  for 
this  case  include: 

1.  integral  square  error 

2.  intdgriai  ttdie  averaged  error 

3 .  settling  time 

4.  percent  overshoot 

3.  maximum  control  force 

6.  maximum  control  power 

7.  maximum  acceleration. 

These  or  other  meaningful  parameters  can  be  used  for  the 
several  headings  of  the  rtoiklng  array.  Hximbers  which  describe  the 
desirability  of  these  parameters  for  a  particular  disturbance  wouj,d 
then  be  filled  in  as  indicated  before  in  Section  2.1.14-.  Optimization 
methods  which  are  described  in  -Ghapter  h  can  be  enqjloyed  to  optimize  the 

value  of  overall  system  desirability  (jj.). 

M 
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A  t\jrtik&r  ert^ulon  of  this  I0  to  coeitAer  •  lAtleb 

la  mbj^ct9d  to  a  contlBuoua,  randoa  diatuxlMiwc  while  to 

follcai  detenelttlstlc  chfto^a  In  the  dealred  41«plae«Mit.  Xf  •  QM« 
existed  where  the  ap«clflcfttia&  cm  both  ot  that#  re^ttlraaMin^  wrm 
reatrlctiTs,  a  joint  Muc^Aanhinii  iarmy  eta  b«  ssM^iiataA 
contaisa  both  atocbaatlc  and  dataradnlatle  munmxem  of  fyataa  wmpatim** 
Tor  each  set  of  control  paraaetars,  the  reapocae  to  both  ttm  moian 
diatur^mce  .\nd  the  deterainlstic  cooaaand  input  can  be  calct^ted  amd 
an  overall  ‘^ysten  dealxmbility  based  cm  ^Iculatl^ia. 


3.0  Azialytlcal  Techniques 

This  chapter  deals  vlth  the  problem  of  determining  tlie 
response  of  a  particular  type  of  nonlinear  system  to  a  stochastic  dis¬ 
turbance.  The  nonlinearity  vhich  is  considered  Is  the  synsnetric, 
unity-gain,  unity-aiiq>litude,  saturating  element  vhose  output  (Y)  can 
be  described  by  the  following  function  of  the  input  (X): 

+  1  for  X  ^  +  1 

X  for  jxj  <4-l  (3) 

-  1  for  X  <  -  1 

Ihie  genezal  form  of  the  symmetric  saturating  element  can  be 
expressed  by  adding  two  linear  gain  terms  to  the  basic  unity  saturating 
element  as  shown  in  Figure  3*  The  \q^r  euad  lower  saturating  limits  are 
-  and  the  gain  in  the  central  linear  region  is  the  product  of 
and  i;^. 

Two  approaches  to  the  general  problem  are  dl'Jcxissed.  Section 
3.1  decLis  with  direct  analog  and  digital  simulation  and  Section  3.2 
considers  the  problem  from  the  point-of-vlew  of  statistically  equivalent 
linear! zation . 

3.1  Simulation  Techniques 

Simulation  methods  are  usually  tised  for  coaplex  or  nonlinear 
systems  which  cannot  be  handled  readily  by  the  more  easily  applied 
linear  techniques.  For  the  type  of  problem  that  is  being  studied  here, 
the're  ar'?  two  additional  factors  which  must  be  considered.  First, 
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since  the  Input  disturbance  is  stochastic,  it  will  be  necessary  to  run 
the  slnaolatlon  for  a  time  which  will  be  long  onoug^i  to  assure  accurate 
mean  square  values  of  the  system  variables.  Secondly,  it  may  be  necessi 
to  test  a  large  number  of  control  parameter  combinations  in  order  to 
determine  the  optimum  set. 

The  use  of  analog  simulation  was  ruled  out  because  of  the 
lengthy  time  required  to  find  an  optimum.  With  the  available  faciiitiei 
individual  run  times  of  the  order  of  a  few  minutes  would  be  the  best 
that  could  be  expected.  The  fact  that  several  tho\isand  of  these  indi¬ 
vidual  runs  are  required  for  three  or  four  parameter  optimization 
problems  leads  to  the  inevitable  conclusion  that  much  higher  speed  analo 
equipment  is  required  for  this  type  of  work. 

On  the  other  hand,  the  very  requirementH  which  caused  the 
rejection  of  the  use  of  analog  simulation  favor  the  lise  of  hJ.gh  speed 
digital  calcxilatlon.  Present  day  hl^  speed  digital  computers  have  no 
trouble  slnulatlng  complex,  nonlinear  systems.  The  major  problems  of 
this  method  are  the  choice  of  the  type  and  length  of  the  random  Ininit 
dlstiurbance  and  the  choice  of  the  computing  Increment  to  be  xised  in  the 
calculation. 

*^3  method  shows  s^aficlent  potential  to  merit  is  retention 
at  this  time.  It  is  compared  with  linearized  methods  In  Section  3*3- 
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3.2  Linearized  Appiroach 


A  second  approach  to  the  problem  is  to  replace  the  nonlinear 
ejement  by  a  linear  element  which  approximates  the  behavior  of  the  non¬ 
linearity.  This  allows  the  problera  to  be  aol/ed  by  conventional  linear 
techniques. 

?or  systems  subjected  to  deterministic  disturbancec ,  the  des¬ 
cribing  fxinctlon^^^*  can  be  used.  Stochastically  disturbed  systems, 
necessitate  the  use  of  a  method  of  linearization  that  produces  a  linear 
element  which  is,  in  some  fashion,  statistically  equivalent  to  the 
original  nonlinearity.  The  problem  was  stvuiied  independently  by 
Kazakov^^^^  and  Booton^^*^'  Kazakov  stated  the  general  problem 

of  finding  the  unknown  moments  of  the  jxrobabllity  distribution  at  the 
output  of  the  nonlinearity  as  functions  of  the  momenta  at  the  input. 

For  a  linear  system  this  is  relatively  slngple,  since  the  protahlllty 

moments  of  the  random  functions  are  linearly  transformed;  the  order 

th 

output  moment  is  dependent  only  upon  the  n  order  input  moment.  Fbr 

th 

the  nonlinear  case,  the  n  order  output  moment  is  also  a  function  of 
the  lower  euid  higher  order  moments  of  the  input.  If  the  input  to  the 
nonlinearity  has  a  Gaussian  (or  normal)  probability  distribution,  the 
first  two  moments  (meeun  and  vazdance)  coagiletely  describe  this  dlstr..« 
bution.  nms,  all  output  moments  are  completely  determined  by  these 
two  input  moments. 

Kazakov  d^iznes  three  means  of  linearization.  In  the  first, 
linear  constants  are  chosen  which  produce  the  same  values  of  the  first 


and  second  nomentc  as  are  produced  by  the  nonlinearity.  The  second 
method  vas  also  suggested  by  Booton  airi.,  in  the  United  States,  is 
usually  referred  to  as  Booton *8  meteod.  This  approach  mlrJ.mizes  the 
mean  square  difference  between  the  outpwt  of  the  linear  asad  ncncancar 
elements.  The  third  method  of  Kazakov  sinqjly  averages  the  result  of 
the  first  two  linecurization  methods.  Kazakov^^^^  lists  these  eqtiiv- 
alent  gains  for  a  wide  variety  of  static  nonlinearities  which  are 
stjbjected  to  a  Oauscsian  input. 

Pbr  the  synoetric,  unity-gain,  unity-aagplitude ,  saturating 
elem«it  of  equation  (3),  which  is  subjected  to  a  zero  mean,  Gaussian 
input  with  variance,  a.,  the  equivalent  gain  calculated  by  the  first 
method  shown  to  be: 


The  second  approach  (Booton 's  Method)  produces. 


(^) 


(5) 
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The  third  method  gives. 


‘  Sct- 


Theee  three  functions  are  plotted  in  Figure  k.  Ka^^^aov 
shove  that,  for  a  Ohussian  input,  is  the  upper  limit  am 

is  the  lower  limit  on  the  actual  equivalent  ^in,  with 
approximating  the  relationship  best  over  the  full  range  of  C-. 

When  nonlinearities  occur  within  feedback  control  systems. 


there  is  no  guarantee  that  the  input  to  the  noiHli^rlty  ie  Gaussian, 
since  the  non-OatiBeian  otrtput  from  the  nonlinearity  is  fed  sack  through 
the  system  to  the  input.  Originally,  it  was  felt  that  the  application 
■would  be  limited  to  nonlinearlticP  which  are  only  "sligtotly”  nonlin^r 
so  that  the  Gaussian  probability  distribution  would  not  be  measurably 
altered.  Sijibsequently,  it  was  observed  that  even  severely  distorted 
signals  were  again  Gaussian  after  passing  throu|^,  for  exaaq^le,  two 
simple  low  pass  filters  of  the  form  i/(»  +  a). 

The  reason  for  this  is  best  explained  by  considering  tlE« 
domain  analysis^^^^  Hie  response  of  a  syston,  y(t),  (»n  be  calciilated 
from  thr  convolution  (or  superposition)  Integral, 


T  )  x(t)  dr 


(1) 


T  )  is  the  system  resfonae  to  ispulse  at  time  t 
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This  integrsl  "weiiJrts”  jauit  values  of  X(t)  according  to  h(t  -  t) 
tanA  iiien  sisas  these  results  over  all  past  hlst^ory.  In  Ms  sense,  1% 
analogous  to  velghting  eufsd  sraaring  a  large  maaber  of  Individual 
slgioals,  vMch,  accordiag  to  the  Central  Llnlt  fheoiw,  should  pro- 
&ce  a  Qaussiaa  prohabllity  diatrihotion. 

®ie  degr  ^  to  which  the  output  aprjnroaches  a  -3au*simi  diatri- 
butlOT  depoMs  upon  the  type  of  system.  The  impulse  respsise  of  a 
simple  gain  Is  an  inpulse  at  time  t  ■  T.  fSxus,  this  convolution  Ince- 
gral  only  sa:^l_j  X(t)  at  one  period  of  time  eo  that  the  prchability 
distribution  form  remains  unchanged.  Conversely,  a  atag^le  integratiac 
gives  a  uniform  ixqulse  response  for  all  t  less  that  t.  This  ccmwolu* 
tlon  samples  all  jnrevlous  values  of  X(t)  unftfomly,  and  as  a  ccaise<zuence 
always  produces  a  pure  Qaiissian  output  prohahility  distribution.  In 
between  these  two  extremes  different  types  of  filters  produce  a  varying 
tei^ency  for  a  xetum  to  (Musslan  distribution.  A  simple  lag  with  its 
Ispulse  response. 


h{t  -  t)  .  forT<t 


h(t  -  t)  a  0 


(8) 


T  '>  t. 


naDoies  prlnarily  in  the  vicinity  of  t  »  t  end  therefore  prc^ucjs  a 
stnaller  re  storation  of  the  Gaussian  distribution  tten,  for  Instance, 
tv-i  iQg?3.  Two  equal,  first-order  lags  have  an  Inpulse  response 
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of, 


h(t  -  t)  »  (t  -  t)( 


-(t  -  t) 


(9) 


vhich  produces  a  vlder  sampling  displaced  somevhat  from  t  ^  t.  There¬ 
fore,  a  qualitative  meaatire  of  the  tendency  for  returning  to  a  Ge\issian 
probability  distribution  can  be  obtained  by  looking  at  the  iispulse 
response  of  the  filter. 

One  other  problem  exists  which  is  peculiar  to  this  type  of 
optimization  study.  One  of  the  end  results  of  optimization  will  very 
likely  be  the  specification  of  the  optimum  linear  gain  for  the  general 
saturating  nonlinearity  shown  in  Figure  5*  Since  only  the  '.alues  of 
0^  ,  K.  and  Ojr  vlll  be  known,  it  is  necessary  to  work  baci::^*ard8  ^o 
determine  K^,  and  Kg. 

Figure  5  shows  the  steps  Involved  in  linearizing  the  general 
limiting  element.  Figure  4  expresses  the  relationship  between  the 
three  different,  "equivalent"  linear  gains  and  the  parameter  B, 


(10) 


Since  Oy  will  not,  in  general,  be  known,  it  is  necessai-y  to  express 

these  fc-quivalent  gains  In  terms  of  .  If  we  define  a  parameter  y 

a 

equal  to , 


>=2 


(11) 
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ve  ee^  that. 


This  nov  allows  us  to  calculate  the  equivalent  gains  as  a 

function  of  y,  by  using  Figure  k.  These  resvlts  are  plotted  In  Figure 

6.  Since  K-  and  cr-  will  be  known  from  the  optimization  results,  the 
^  *a 

equivalent  gain  can  now  be  determined  directly  from  the  saturation 
limit,  Kg. 

It  is  interesting  to  note  that  each  curve  of  Figure  6  has  a 

minimum  value  of  y  for  which  a  value  of  exists.  For  the  first, 

equal  variance  method,  this  value  of  v  is  •r^/2  It  is  readily  seen 

that  this  corresponds  to  a  value  of  equal  to  unity.  Since  the 

maximum  value  that  can  attain  is  unity,  it  is  obvious  that  its 

r.m.s.  value  can  never  exceed  unity.  The  second  method  gives  this 

limiting  value  of  y  as  H^/2.  This  corresponds  to  a  maximum  value  of 

This  points  out  the  fact  that  the  mean  square  output 
c 

of  the  linear  and  nonlinear  elements  will  not,  in  general,  be  equal  for 
this  method.  This  difference,  of  course,  originates  from  the  assumption 
basing  statistical  equivalence  on  a  minimum  mean  square  error.  For  this 
type  of  nonlinoarity,  this  difference  can  be  almost  totally  attribut  d 
to  the  large  fourth  order  probability  moment  which  is  present  in  the 
nonlinearity  output.  This  ccanponent  is  Ignored  by  the  first,  eqxzal 
variance,  method. 

3.3  Comparison  of  Simulation  and  Linearization  Techniques 

Two  aspects  of  the  employment  of  these  two  approaches  will  be 
rucBeu  here.  The  first  deals  with  nov  readily  each  method  a^y  be 
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adapted  for  digital  computer  calcuJatioi  .  The  second  Is  concerned 
with  a  comparison  of  the  computation  time  required  by  the  two  methods. 

3- 3*1  Adaptability  to  Digital  Computer  Calculation 

Any  method  of  digital  computer  simulation  requires  the  use 
of  some  type  of  finite  difference  calculation  method.  One  of  the  more 
critical  steps  with  finite  difference  approaches  is  the  choice  of  the 
time  Increment  to  be  used  in  the  calculation.  Time  intervals  which  are 
too  long  lead  to  inaccuracies  or  even  completely  erroneous  resxilts.  If 
the  time  interval  chosen  is  shorter  than  is  necessary,  long  computation 
tlmea  will  result. 

In  optimization  studies  it  is  sometimes  necessary  to  vary  the 
control  parameters  over  wide  ranges.  This  can  cause  the  system's 
natural  frequencies  to  vary  widely  and  result  in  the  additional  require 
ment  that  a  satlsfactoiy  value  of  the  time  Interval  be  determined  for 
each  set  of  control  parameters  which  is  tried.  This  complicates  the 
cooxsiiter  program  and  can  add  a  significant  amount  of  computation  time 
to  the  solution  of  a  problem. 

If  a  linearized  solution  is  used,  finite  difference  techniques 
may  not  be  required.  Appendix  E  of  Newton,  Gould,  and  Kai83r^^^^  lists 
the  general  algebraic  solutions  of  the  mean  square  values  for  first 
through  tenth  order  systems.  These  are  in  a  form  which  is  readily 
adaptable  to  digital  computer  calculation.  If  these  equations  are  used, 
two  very  important  facts  must  be  remembered: 


} 


1.  These  equations  do  not  apply  to  unstable  systeos. 
Therefore,  stability  must  be  checked  by  means  of  the 
Routh  or  other  criterion  before  usln^  them. 

2.  Round-off  error  can  be  a  problem  with  the  hl^^r 
order  systems.  It  Is  generally  recoiia»ndsd  that  the 
equations  for  seventh  through  tenth  order  systems 
should  not  be  used  unless  double  accuracy  (16  place) 

(21) 

computer  calculation  methods  are  eaqiloyed'  , 

For  high  order  systems,  it  nmy  be  sinq>ler  and  quicker  to  use 
finite  difference  Integration  of  the  general  integral, 

than  to  employ  double  accxiracy  calculation  methods.  Direct  integra¬ 
tion  is  particularly  simple  If  the  input  disturbance  baa  a  narrow  band 
power  density  spectrum  This  permits  equation  (13)  to  be  r'^ced  to: 


where  and  L2  represent  the  lower  and  upper  frequency  limits  of  the 
narrow  band  power  density  spectrum  of  the  system  input. 

If,  however,  the  Input  spectrum  Is  considerably  wider  than 
the  expected  frequency  response  of  the  system  tranfer  fhnctlcsi,  the 
problem  Is  more  difficult.  In  this  case,  tbs  peaks  of  the  output 


pover  Bpectnun  n»y  vary  considerably  due  to  changes  In  the  control 
parameters.  One  now  has  the  choice  of  using  finite  difference  Inte¬ 
gration  with  a  small  frequency  Increment  over  a  wide  range  of  frequencla 
or  tailoring  the  finite  difference  integration  to  match  each  particular 
output  power  spectrum.  The  first  method  results  In  longer  conqputatlon 
times,  while  the  second  requires  a  more  complex  computer  program. 

3.3*2  Computation  Tlok'  Requirements 

Although  it  is  rather  ridiculous  to  speak  of  the  computation 
time  for  an  ’average"  order  system,  it  is  necessary  to  have  some 
way  of  comparing  the  several  analytical  methods  to  determine  which  can 
give  results  in  a  reasonable  period  of  time.  For  this  reason,  some 
estimates  of  computation  time  for  the  IBM  7C9^  computer  have  been  made 
based  on  the  following  assumptions: 

1.  ‘fhe  time  required  to  determine  the  coefficients 

of  the  n^  order  transfer  function  is  equal  to  the 

time  that  it  takes  to  evaluate  the  corresponding 
t>> 

n  order  equation  of  Appendix  E  of  Newton,  Gould, 
and  Kalser^^®^  (Tills  turns  out  to  be  reasonably 
accurate  for  the  3i^>  6tb,  and  10th  order  systems 
studied  in  Chapter  5*) 

2.  Finite  difference  integration  of  the  power  spectrum 
will  require  an  average  of  fifty  points. 

3.  The  computation  time  of  simulation  methods  is  pro- 
poirtlonal  to  the  order  of  the  system. 


The  reaults  for  the  algebraic  evaluation  and  Integration 
methods  vere  obtained  for  a  single  mean  square  value  (m  =  l)  and  for 
the  calculation  of  n  mean  square  values  (m  ■  n). 

The  simulation  approach  automaticallj  gives  all  mean  square 
values  since  it  was  based  upon  a  simple  trapezoidal  finite  difference 
integration.  Some  time  saving  mlf^t  be  made  by  using  larger  time 

(22) 

increments  with  a  more  accnirate  simulation  method  such  as  Bunge-Kutta^  ^ 
or  the  Mitrlx  Exponential 2k) ^  initial  results  were  sufficiently 

poor  for  systeir.s  of  tenth  order  and  less  to  dlscoumge  any  additional 
work  along  these  lines  at  this  time. 

In  spite  of  the  estiamtions  involved  in  obtaining  these 
approximate  relations,  a  few  conclusions  can  be  drawn  from  Figure  Jt 

1«  Direct  algebraic  evaluation  is  superior  for  systems  up 
to  the  point  where  double  acoAracy  ca3  -rxilatlons  are 
required. 

2.  In  the  neighborhood  of  tenth  order  systems,  either 
integration  or  double  accuracy  algebraic  evaluation 
can  be  used.  The  decision  should  be  based  upon  the 
number  of  Integration  points  to  be  used,  the  average 
nvunber  of  mean  square  values  to  be  calculated,  etc. 

(it  should  be  remembered  that  the  integration  method 
is  easier  to  program  than  the  algebraic  evaluation 
method  for  systems  of  this  order.) 


Syates  Qrdsr  (n) 
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3*  Direct  Integration  should  be  uaed  for  lysteM 
above  fifteenth  or  tventleth  order. 

4  Simulation  should  only  be  used  when  the  pro¬ 
gram  simplicity  is  more  important  than  the  ccn- 
putatlon  time,  or  when  the  system  nonllnearltles 
camnot  be  handled  properly  throu^  equivalent 


lines rizatlon. 


^.G  Optimization  Techniques 

The  choice  of  the  Multiple -pBrameter,  Mix-Ranltlng  Optimization 

Criterion  which  was  introduced  in  Chapter  2  places  a  restriction  on  the 

typ«  of  optimisation  technique  which  can  be  employed.  Standard  methods 

of  calculus  cannot  be  used  because  the  slopes  at  the  various  mlnlnm  will 

not,  in  general,  be  zero.  The  reasons  for  this  are  given  in  Section 

2,l.h  and  exanqples  are  shown  in  figure  6  and  in  Sections  ^.2  and  5* 3* 

(25 ) 

Some  types  of  steepest  ascent'  '  optimization  might  be 
employed.  The  general  n-dlmensional  steepest  ascent  method  uses  some 
form  of  the  following  logic: 

1.  Determine  the  partial  derivatives  with  respect 

to  each  of  the  a  dimensions  at  the  present  position. 

This  is  usually  done  by  calculating  the  ^alue  of  the 
function  whose  i^Lnimum  is  being  sou^t  at  small 
Increments  on  either  side  of  the  present  position. 

The  average  partial  derivatives  throu«^  the  present 
location  can  then  be  calculated  for  that  particular 
dimension.  This  is  repeated  for  all  n  dimensiona. 

2.  Detenuine  a  ucw  location  by  choosing  incresients 
for  each  of  the  n  dlfflenaions  proportional  to  their 
own  partial  derivatives.  (The  directions  chosen 
for  each  dimenaion,  of  course,  depends  upon 
whether  a  oaxinua  or  a  odnliam  is  being  sought^ 


This  parti culiir  choice  of  increnents  forcea 
the  nev  location  to  be  in  the  direction  of  the 
steepest  path  which  passes  through  the  old 
location. 

3.  Stepa  1  and  2  are  repeated  \intll  a  local  osuc* 
loa  (or  mlniffluffl)  is  reached.  In  actuality, 
the  search  Is  stopped  when  all  the  partial  der¬ 
ivatives  are  below  some  predetermined  level, 
since  otherwise  the  search  could  go  on  ixtdefln- 
Itely  looking  for  exactly  zero  partial  derivatives. 

4.  Repeat  stepa  1  throu^  3  for  several  starting 
points.  This  Is  necessary,  since  each  starting 
point  can  only  result  in  the  determination  of  a 
single  extreoojuB.  In  most  laultldiMttSlonal 
problems  there  will  be  several  relative  eztraaa. 

The  introduction  of  the  Max-Ranking  Perforsanee  Criterion 
creates  two  additional  prohlema  for  the  steepest  sscsnt  method.  Siaea 
the  surface  whose  olnlaiua  is  being  sought  Is  a  cosgosite  foraed  by  the 
upper  selection  of  s  number  of  surfaces,  there  will  be  Intersaettoos 
of  the  surfaces  with  corresponding  discontinuous  derivatives.  This 
can  cause  problems  In  the  determination  of  the  local  partial  deriva¬ 
tives  and  in  the  decision  as  to  when  a  local  extrosa  has  been  reached. 
Secondly,  moat  extreaa  will  occur  at  the  intersection  of  teo  or  more 
of  these  hypersurfaces.  Thus  it  will  be  certainly  praslble  to  have 
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Figure 


large  valued  deorivatives  In  the  limsediiste  vlcljilty  of  or.  extrepnis:. 

6  shovs  a  typical  perfonoance  curve  for  a  one-dliceaclonai  Qpffcisalzat,lo.o 
vhicb  l8  eoploylng  the  ffcc-liaaking  Cbriterion.  A  high  value  ot  the  slope 
at  position  (a)  vould  dictate  a  large  incrementing  step  C^K)  to  loca¬ 
tion  (h).  This  could  very  easily  result  in  a  search  process  vhich 
oscillated  back  and  forth  vlthout  ever  convergiiig  on  the  actual  ainimun: 
vmless  special  precautions  vere  taken  to  guard  against  this  situation. 
These  difficniltles  add  complexity  to  an  optimization  procediire  vhich, 
for  multiple  dimensional  seerchee,  is  already  quite  complex  and  lengthy. 

T3ie  steepest  ascent  method  provides  excellent  results  for  a  search 
of  veil -behaved,  unimodal  functions.  Brooks  has  shovn  that  for 
unioodal  functions  of  two  variables  the  steepest  ascent  method  is  sui>erior 
to  a  nunfcer  of  other  methods.  In  particular,  Brooks  states  that  sequen¬ 
tial  methods  (l.e,,  methods  which  base  a  course  of  action,  at  least  in 
part,  upon  the  past  results)  give  generally  better  results  than  non- 
sequentia]  methods.  However,  if  it  is  necessary  to  find  the  ertrema 
of  function.  ^  -iil-h  -ii-e  not  unimodal,  the  problem  is  more  con5)licated. 

It  is  now  necessary  to  use  a  nxanber  of  starting  points  to  be  assured 
that  all  local  extrema  In  the  range  of  interest  are  fotind. 

If  the  required  number  of  starting  points  for  a  one -dimensional 
problem  is  "M”,  the  nvmiber  of  starting  points  for  the  equivalent  n- 
dimenslonal  problem  is  This  can  be  reduced  somewhat  by  various 

additions  to  the  computer  program.  For  exanple,  since  a  large  number  of 
starting  points  aay  result  in  determining  the  same  extrema,  the 
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calculation  for  a  particular  starting  point  can  be  discontinued 

vhen  it  is  cb-.-louc  ttst  a  previounly  deteruilned  extrema  is  again 

(27) 

being  approached.  Gelfand  has  suggested  a  method  which  operates 
a  little  differently  from  this,  but  which  has  about  the  same  end 
result.  The  presence  of  regions  of  instability  within  the  search 
space  nay  greatly  conplicate  the  steepest  ascent  approach.  It  is 
certainly  possible  that  a  significant  fraction  of  the  steepest  ascent 
paths  will  lead  into  regions  of  instability.  When  this  occurs,  methods 
nust  he  formulated  to  circumvent  these  regions. 

It  can  therefore  be  concluded  that  steepest  ascent  methods 
can  be  readily  applied  to  unimodal,  one,  two  or  possibly  three- 
dimensional  optimizations.  The  added  complexity  of  the  Max -Ranking 
Optimization  Criterion,  the  regions  of  instability  and  the  higjier 
dimension  searches  which  are  treated  here  in  Chapter  5  rule  out  the  ixse 
of  this  method  for  this  type  of  application. 

4.1  Random  Search  Techniques 

The  basic  concept  of  a  random  search  is  not  new.  However, 
inprovemcnts  in  digital  conqputer  speed  within  the  past  few  years  have 
now  enabled  random  search  methods  to  be  applied  to  more  complex  problems. 
Other  people  have  contributed  to  this  fleld^^®^,  but  probably  the  most 
complete  treatment  is  that  given  by  Kamopp^^^'  Kisrnopp  stiggests 

a  number  of  ways  of  enqjloylng  random  search.  Only  three  general  methods 
are  discussed  here. 
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The  various  types  of  rondos  search  :,.3thods  can  beet 
explained  throu^  the  use  of  a  simple  exainpie.  CorKiacr  th  : 

function,  F{K),  shovn  in  Figure  9*  It  is  required  thrt  v  '  c  ’ 

raininaan  of  the  fu  ion  betveen  the  limits  of  K  and  K , . 

The  first  approach  to  the  problem  mi  gh u  be  iXC'  a  p ^ .i~ 

random  s^rch-  This  involves  making  completely  random  choices  of  h 

between  K  ■  K  and  K  «  E , .  search  probability  density  funciLon 

a  d 

vhich  describes  the  selection  process  is. 


*  r"hr  '^d  ? 

d  a 


and 

p  (K)  ■  0,  elsevhere. 

6 

It  is  easy  to  shov  that  the  probability  of  choosing  a  number  within 

-  A  K  units  of  the  actxml  ndnlimim  at  K  is: 
c  c 


p(K  +  AK  >K>5  -  ^  { 

^'c  c--c‘*^c'  K,  -  K 

o  a 

As  rnl^t  be  expected,  this  is  one  of  the  least  efficient  r^doo  sea 
procedures . 

A  second  ppprc«.ch,  arai  one  suggested  by  Kamopp,  Is  to  us 
a  purely  random  search  for  only  the  first  ;^a.5e  of  the  search.  At 
end  of  this  phase,  ■' he  value  of  K  vhlch  has  ven  the  roves t  value 
F(K)  Is  recorded.  This  best  previous  value  of  K  is  denoted  as 
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Th«  paxmawter  takes  on  the  new  vOue  of  K  each  tlae  a  choice  la 
made  which  produces  a  value  of  T(K)  lover  ttasm  the  previous  value, 
F(K^).  The  search  probability  density  function  for  the  second  phase 
is  taken  as. 


and 

p  (K)  «  0,  elsewhere. 

This  provides  a  unifom  probability,  local  random  search  which  la  cen> 
tered  around  the  best  previous  value  of  C(E  <•  K^).  If  la  Isnrge, 

this  phase  will  behave  such  like  the  purely  landosi  search  of  the  first 
phase.  If  is  SEoall,  in  particxilar,  if 


;  iKc  ■’S.i  ' 

the  probability  that  the  next  choice  la  an  Improvattent  over  the  best 
previous  value  is  0.5.  Since  we  have  no  prior  knovlad^  aa  to  the 
locatlor  of  K^,  It  is  iiqpoeslble  to  determine  beforehand.  The 
above  relationship  indicates  that  the  maaller  the  value  of 
higher  the  probability  that  the  next  choice  will  be  aa  layrovamsnt.  On 
the  other  hazul,  the  expected  change  In  E,  l(  |AKpf  will  decrease  with 
decreasing  ^E^> 


Thus  we  see  that  Jsnall  values  of  A  nay  give  a  higher  probability 
of  lEprovement,  but  the  improvements  obtained  will  be  sneiler. 
Kamopp^^^^  suggests  a  way  to  vary  AK,  in  order  to  i:uprove  this 
phase  of  the  search  procedure. 

One  of  the  underlj-lng  objectives  of  this  work  was  to  arrive 
at  a  method  of  solution  which  would  be  sufficiently  general,  yet  be  as 
simple  as  possible  to  implement.  Therefore,  an  attempt  was  made  to 
find  a  random  search  procedure  which  was  more  efficient  than  the  puiely 
random  search  and  less  complicated  than  the  previously  mentioned  method. 
The  one  which  has  shown  the  most  promise  is  the  exponential  random 
search,  a  method  which  bears  some  resemblance  to  the  "creeping"  random 

(2S ) 

search  suggested  by  Brooks'  . 

This  method  en5)loys  a  search  probability  density  which  is 
largest  at  K  »  and  tapers  off  exponentially  on  both  sides  of  K  Kj^. 
This  is  expressed  as, 


TulC  search  ^  , 'y  f”*,  ’■♦■y  1.  ■•n  pj ®  ■»  r 

of  K  -  for  several  values  wf  m.  The  integer  m  must  be  odd  in 

order  to  produce  a  search  probability  density  symmetric  about  K  =  Kj^. 

This  seemingly  complicated  search  probability  density  was 
chosen  because  it  can  be  generated  very  easily.  Most  con^iutatlon  fac¬ 
ilities  have  a  8ln5)le  subroiitine  which  generates  random  numbers.  Th« 
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Figure  10 


9g«rch  Probability  Dennity 


vher*i 


M.  I.  T.  Con^ntation  Center  siibreutine  1?  RM1I0F(B), 

B,  for  otir  purposes,  is  e  d\iirany  variable.  This  subroutine  generates 
random  nximbers  betveen  zero  and  one  with  uniform  probability  density 
With  the  aid  of  this  subroutine,  a  new  value  of  K  can  be  generated 
with  only  the  following  single  Fortran  statement: 


AK  =  AlCB  +  (AED  -  AKA)  *  (  (2.wRAKH0F(b)-1.  )  *m). 


where 


AK  -  K, 

AKA  K  , 

a 

AKB  »  K^, 

AKD  «  K^,  and 

M  the  exponent  (m). 


The  probability  density  is  somewhat  al-tered  by. the  fact  that  values 

of  K  greater  than  K.  or  lees  than  K  are  disallowed.  A  random  search 

d  a 

with  a  search  probability  density  of  this  form  has  several  advantages. 
First,  a  certain  percentage  of  large  steps  will  be  taken.  This  is 
advantageous  during  the  initial  jhase  of  a  search.  It  is  also  important 
ror  functions  which  are  not  unimodal,  since  it  is  certainly  necessary  to 
be  able  to  move  from  the  area  of  a  relative  minimum  to  the  vicinity  of 
the  true  minimum.  In  fact,  it  is  svjggested  that  the  search  procedure 
be  set  up  so  that  any  point  in  the  seeurch  space  can  be  reached  in  CTie 
step  from  emy  other  point  in  the  seeu'ch  space. 


Available  Co| 
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Althou^  the,  random  search  method  which  uses  the  changing 


probability  density  function  shares  most  of  these  advantages,  the 
exponential  random  search  requires  fewer  decisions  to  be  made  during 
the  operation  of  the  digital  computer  program  and  is  therefore  simpler 
to  program.  For  this  reason,  the  exponential  random  search  was  selected 
for  this  study. 

k,2  General  Properties  of  the  Exponential  Random  Search 

One  of  the  dlfficxlLties  with  studying  or  compering  search 
techniques  is  the  necessity  of  choosing  some  particular  function  on 
which  the  search  can  be  carried  out.  This  can  lead  to  many  mis¬ 
conceptions,  since  search  techniques  which  work  efficiently  with  one 
type  of  function  may  behave  poorly  with  others.  For  this  reason,  the 
reader  shoiild  keep  in  mind  the  fact  the  results  obtained  are  for 
specific  types  of  functions.  Although  an.  effort  has  been  made  to 
make  the  function  as  general  as  possible,  there  is,  of  course,  no 
guarantee  of  general  applicability. 

Consider  the  function  of  Figure  11,  which  has  the 
following  properties: 


1.  It  is  symmetrical  about  K  =  0. 

2.  Only  the  portion  between  K  =  K  and  K  =  +  K 

S  G 

will  be  considered. 
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3.  The  ruTict-'on  betvt-^n  K  -  '  and  K  -  +  K  is 

A 

aonctcni cally  Increasing. 

U.  The  function  need  not  be  contlnuotis  in  slope. 

Ihe  best  value  obtained  at  this  point  in  the  search  la  K  »  Each 

nev  value  of  K  chosen  is  calculated  from, 


where  m  is  an  odd  Integer  and  is  a  random  variable  having  the 
probability  density, 


p(Gj^}  -  1/2 


for 


I°kI  5 


<  1 


(21 ) 


and 


Since 


p(Gjj)  ■  0  elsewhere. 


p(K)  dK  -  p(Gj^)  d  Gj^,  (22) 

the  search  probability  density  of  K  can  be  readily  determined  to  be 


_  ''-s, 

■  2m  K  '“5k  ' 


l*m 

lU 


(23) 


a 


which  is  a  special  form  of  equation  (19) 

•Rie  probability  of  reaching  a  lower  value  of  F(K)  on  the 
next  attempt  is  call  the  probability  of  iuprovement,  pj(Kjj).  This  Is  ^ 
equal  to: 


ciJ 


I  o  f’"*,  f  f":k 
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Pp(K)  iK 


(24) 


Eqviation  (23)  du.s  not  include  thie  effects  of  disallowing  all  values 
of  K  less  thar.-K  and  greater  tlian  +  K  .  Tlie  dencninator  of  equa- 
tlon  (24),  therefore,  represents  the  fraction  of  all  possible  choices 
which  fall  within  the  accepted  region.  The  Inclusion  of  the  denosain- 
ator  represents  the  fact  that  disallowed  choices  are  ignored. 

Equation  (24)  can  be  evaluated  using  equation  (23),  with 
the  resiilt. 


(25) 


which  is  plotted  in  Figure  12  for  several  values  of  m.  For  coi^rison 
purpoaea,  the  value  of  m  -  1  was  also  included.  This  repreaents^be 
•  ’  /  r&iMlouj  cearch.  ^he  ouaer  extrene  is  rerresented  by  m  «  • 

wfllcb  produces  a  value  of  Pj(J^)  eqv*-!-  to  O.5  for  all  values  of 
except  zero  and  1.  It  Is  interesting  to  note  the  probability  of 
improvement  for  various  values  cf  m  when  -Ol* 


ngftrm  12 


m 

V-r'X  ) 

A. 

1 

'J.Gl 

3 

0.136 

5 

C.2.;^9 

7 

0.236 

9 

0.324 

Oft 

o 

• 

o 

Table  2 


I»ix>babllity  of  Improvement  at  the  Point  (K.^/K^  “  >01) 

This  Indicates  vhy  high  values  of  m  ere  better  in  the  final  stages 
of  a  search. 

A  second  characteristic  which  is  Important  is  the  expected 
step  length.  E([  ^xj).  The  dimensionless  expected  step  length  is 
equal  to; 


•t-K 


tM) . 


I. 


a 


Ik -1^,1 


Pg(K)  dX 


S(^) 

^a  +K 


(26) 


/ 

J-K 


pJX)  dX 


nils  can  be  integrated  in  a  fashion  similar  to  tne  prevlotis 


exaflQ>le»« 


r\ 

L- 


.  5k  • 


1  -  K,  /K  ^  W  K,  /K  — 
/  D  a »  m  ,  D  a ,  ffl 

( - )  *  t - ) 


Mil 


K  '  m+1 

a 


1  -  1C  ;k  -  1  +  K.  /K  - 

/  o  a »  ra  /  D  a »  n 

( - )  +  ( - ) 

2  2 


Tlilr.  1  t‘latli.-nKhii.  is  pi  ■  ttc-d  in  Fiffoi-t;  !■'. 

There  is  'ine  'jth'.  r  piece  of  inforratlon  which  can  be  obtained 

from  this  gen-  ral  iniirric-dal  i'un-'tlc.n .  This  is  the  probability  density 

of  the  location  of  i-h'  eurr-’nt  btst  vain.  (K^, )  after  choices  have 

been  cade.  Glnc  the  prolabillty  density  of  the  position  of  the  n/xt 

p-'int  to  be  choG’ n  in  only  a  function  of  the  current  location  of  K^, 

( ^1 ' 

tills  process  is  called  a  Markov  process  .  A  random  process 
described  by  K(t)  is  a  Markov  proc(.‘33  if  and  only  if,  for  every  finite 


set  t,  <  t^  < 


<  t  ,  <  t  , 
r-j  n 


p(X  .  t  lx,  ,  t,  ; . ;X  .  ,  t  ,  )  -  p(X  ,  t  lx  ,  ,  t  ,  ) 

n  n'  1  1  n-i  n-1 '  u  n'  n-1'  n-l ' 


A  very  convenient  property  of  a  Markov  process  is  this  fact,  that  the 
probability  density  at  any  state  is  only  dep  •ndent  upon  the  probability 
density  at  tht-  previous  state  and  the  transition  probability  density. 
Therefore,  given  the  initial  starting  point  and  the  probability  density 
which  describes  the  iiicrementing  or  stepping  process  (Figure  lO),  it 
Is  theoretically  possible  to  determine  the  probability  density  of 
for  each  step  In  the  search  process.  In  practice,  It  Is  not  poaslble 


bH-si  /wayaDb 
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to  do  this  directly  because  the  integrala  Involved  very  rapidly  grow 
too  complex.  Th'’r'’^or*‘ .  firrt  uccccssiy  to  tranofjiui  cue  weveral 

continuous  probability  density  function  into  ulscretc  functions.  The 
probability  of  the  1^^  discrete  value  of  •r  choices  (p(\. 

K^))f  g^ven  p(K^j,  -  l)  Is  obtained  as  follows: 

1.  Multiply  the  probabilities  at  .-Jtep  -  1 

by  their  corresponding  probability  of  Improvement, 

disorete-\'ar.able  verslcn  of  Figure  11.  This 
gives  the  portion  for  which  there  will  te  ax. 

Impr.^vement, 

2.  Tills  portion  is  then  distributed  over  the 
allowable  regions  according  to  the  exponertial 
seerch  probability  disti Ibutlon.  (By  "allowable" 
we  mean  that  portion  of  the  function  P(K)  which 
is  leas  tlian  F(K^)). 

3.  Repeat  step  2  for  all  values  of 

end  at  each  point  K^(l)  n  sum  the  contrlbatlons 

c 

from  all  such  points. 

4.  Multiply  the  probabilities  at  step  N^-1  hy 

(l  -  Pj(lC^)).  •Rils  gives  the  portion  for  which 
there  will  be  no  improvement. 

Add  this  static  portion  to  the  changing  portion 
obtained  in  step  3* 


..  . 


f\  1  /  O' ' 
/"W  C4 
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Thl»  process  was  prograaned  for  a  digital  con^wter  and  reeulta  wtre 
ojUiined  for  two  values  of  the  exponent  b  (m  =  3  and  a.  »  9)*  Th* 
results  are  shown  In  Figures  14,  19  and  l6. 

The  results  dencnstrate  the  g-neral  chare -teristlcs  vSsich 
can  be  predicted  qualitatively  on  the  lasls  of  Figures  12  and  13, 
that  la,  low  values  of  m  produce  more  rapid  initial  convergence,  but 
slower  final  convergence  than  higher  value-.. 

It  should  be  reiLemhered  here  that  these  results  are  for 
unlmodal  functions.  The  problems  of  mulU»f*jdal  functions  are  more 
complicated  by  an  order  of  magnitude.  It  la  Iniposslble  to  find  a 
value  of  the  exponent  m  which  is  optimum  for  all  multimodal  systems  and 
It  la  rldlc\iloas  to  obtain  the  optimum  value  of  m  for  one  particular 
function.  Some  general  recommendations  csui  be  made,  howe'mr.  These 
are  presented  in  Section  k.k 

An  exponential  random  search  for  a  mlitlwjBi  ai^t  be  called  aa 
"Inebriated  Random  Valh".  In  this  case,  the  often-dlacusaed  alcoholic 
still  cannot  control  his  direfctlon  or  step  length,  but  he  at  least 
realizes  that  he  Is  in  no  shape  to  walk  uj^ll. 

4.3  Multi dlmens  1  onal  Random  Search 

One  of  the  basic  attributes  of  raiwloa  search  met'iods  la  the 
fact  that  the  prograomlng  of  a  general  n-dlmenalonal  search  Is  no 
more  complex  than  the  programnlng  of  the  two -uImusI onal  search.  Cm 
following  five  Fortran  statensnts  are  sufflclsnt  to  select  the  naw 
trial  point  for  the  general  nnllaenslonal  caset 


Fl*ur«  lU 

Probability  Dlttrlbutioo  of  K 


Ptfurv  1$ 

frobablllty  Dlitrlbutlon  of  t 
•rt«r  CholemB 


P(K) 

.6 - 

»i  9 

laerwMtnt* 


Flipim  16 

0>«i*  of  CtMnrm^no* 
at  TVo  tepoo»atl»l  R— doa  a«Tciwt 


p(iV*^lr 


1.  D0  5  I  «  1,  H 

2.  AK(I)  »  AKB(l)+(AKD(l)-AICA(l))*((2.«RjUni5fr(B)-l.)**M) 

3.  Ii’(AK(l)-AKA(l))  2,  2v,  if 

If.  IF(AKD(I)-AK(I))  2,  5.  5 

5.  CONTINUE 


Tho  subscript  (l)  refers  to  the  I  dimension  (l  •  Iton).  !lSie 
remaining  terms  are  as  previously  defined. 

Although  the  simplicity  is  nBlntained  for  the  higher  dimen¬ 
sional  search,  the  search  efficiency  can  be  expected  to  deteriorate. 
Figure  17  shovs  one  qviadrant  of  the  tvo -dimensional  search  probability 
density.  It  Is  obvious  from  this  figure  that  this  type  of  search 
profile  provides  a  raore  efficient  s.-arch  along  the  principal  axes 
than  In  the  diagonal  directions.  During  the  course  of  this  work, 
both  spherical  and  ellipsoidal  profiles  were  tried  in  an  attempt  to 
produce  a  more  rotatlonally -balanced  search  probability  density.  Theee 
methods  worked  satisfactorily  for  two  dimensions,  but  the  increase  in 
con^>lexlty  for  higher  dimensions  was  not  wojrth  the  scsaewhat  douhtful 
gain  in  search  efficiency. 

The  worst  multidliaenslonal  search  for  the  exponential  prr- 
bability  density  is  one  which  would  continue  to  move  along  a  diagonal. 
!l^e  best  case  is  one  which  would  continue  to  move  along  tha  principal 
eucee.  Thus,  these  two  extremes  nust  certainly  bracket  all  possible 


cases. 


0  0.?  o.^^  0.6  o.d  1.0 

'^i  -  *ib 


The  probability  ol  improv-^^-aent  for  th  *  diagonal  search  is 
plotted  in  Figures  l8  and  19  for  several  values  of  n  and  two  values 
of  ra.  The  one-dlraenaional  search  (n  ^  l)  is  also  plotted  since  it 
represents  the  naximun  search  efficiency  In  each  case.  FiDm  this  it 
is  obvious  that  the  nun;ber  of  trials  must  necessarily  Increase  with 
tht.-  d' ffienslonallty  of  the  pu'oblt-m.  An  empirical  formula  has  been 
f  :)und  to  be  helpful  for  determining  how  many  test  points  are  necessary 
to  give  a  reasonable  conildence  in  the  search  result: 

(Nc^ 


This  states  that  the  number  of  cholc,‘8  for  on  n-dimenslonal  seexch  is 

roughly  equal  to  the  number  required  for  a  comparable  one -dimensional 

st.-arch  times  2  to  the  (n  -  1 )  power.  The  ntanber  of  choices  (N  )  refers 

c 

to  the  number  of  choices  which  do  not  fall  into  a  region  of  instability. 
This  empirical  rslatlcnshlp  Is  based  on  a  large  number  of  one  through 
five -dimensional  studies.  The  few  runs  which  were  n«de  at  hi^er 
values'  of  n  (up  to  and  including  9)  tend  to  show  that  this  la  too  i>e88l- 
mlstlc.  This  is  reiiiainly  one  area  In  which  more  work  Is  needed. 


4.4  General  Recommendations  for  Appljlng  Random  Search  Techniques 

Very  little  infonratlon  is  available  on  the  application  of 
random  search  methods  to  practical  engineering  probleaa.  It  is  the 
purpose  of  this  section  to  list  some  of  the  jjracticea  which  evolved 
during  this  study.  In  addition  to  the  three  applications  described  In 


f  ■= 

r" 
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Chapter  5^  a  ntnnber  of  multidimensional,  xmiixidal  functions  vere 
studied.  This  was  done  in  an  attempt  to  become  more  familiar  with 
the  behavior  of  random  search  techniques  for  known  functions,  so  that 
an  easier  transition  could  be  made  to  the  more  complex  engineering 
problems.  This  tximed  out  to  be  time  well-spent.  Many  of  the  follow¬ 
ing  recommendations  are  based  u-:>?n  information  learned  during  this 
phase  of  the  study. 

1.  ?br  low  dimensional  searches  (n  =  1  through  3)j  an 
exponent  (m)  of  3  or  5  vill  provide  sufficiently 
rapid  convergence  for  most  practical  problems.  If 
accuracies  better  than  -  1^  are  required,  the  final 
portion  of  the  search  can  be  conducted  using  an  exponent 
of  7  or  9* 

2.  Convergence  to  within  -  of  the  actual  extremum 
can  be  expected  within  100  choices  ((N^)^^  =  100 ) 

for  a  one -dimensional  search  of  a  system  which  is  not 
interrupted  by  unstable  regions  for  em  exponent  (n) 
eqxial  to  3* 

3-  More  choices  are  required  for  systems  which  have 
a  higher  percentage  of  the  search  space  taken  up  by 
unstable  regions.  Evidentally,  the  distxirbance  of 
the  normally  smooth  search  ’'flow"  is  of  more  ic^xjrtance 
than  the  benefit  obtained  from  the  reduction  of  the 


search  space. 
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There  are  at  lea«t  two  equally  acceptalle  aethodt 
for  terminating  the  search; 

«•  Stop  after  a  given  number  of  choices 
(R^).  (Tills  does  not  include  any 
cholcea  which  fall  in  unstable  regions.) 
b.  Stop  after  a  given  number  of  stable 
choices  fall  to  produce  an  Improvemert 
of  a  certain  percent  (for  exanqjle,  .Oljt). 

5.  ?br  complex,  multimodal,  rmiltxdimenalonal  problems, 
It  Is  beat  to  nun  at  least  two  ct^rt,  less  exact 
(ni  .  3}  searches  starting  from  different  positions. 
JS  these  tend  to  converge  In  one  location,  there  Is 
a  high  probability  that  the  true  extrema  Is  being 
apjjroached.  A  higher  exponent  search  (m  «  7  or  9) 
can  then  be  Initiated  at  the  end  position  cf  one  of 
the  previous  searches.  If  two  or  more  locations 
result  from  the  initial  searches,  each  of  thes.;  jmy 
have  to  be  searched  more  exactly  to  determine  thv 
true  minimum.  Thla  is  usually  «  acre  satisfactory 
procedure  than  running  one,  long,  exact  search. 

6.  The  search  efficiency  can  usually  be  improved  by 
running  a  purely  random  f-earch  (m  .  1)  for  the  first 
10  or  2C$  of  the  total  search,  an  exponential  search 
with  »  -  3  for  the  next  1*0  tp  60Jt  of  the  search,  and 


r  w 


1 


an  exponential  search  vlth  a  ■  7  9  for  the 

renalnder  of  the  search. 

7.  ftjr  complex  systetes  containing  several  regions 

of  instability,  it  nay  be  desirable  to  detenslne  the 
shape  of  the  function  in  the  vicinity  of  the 
axtremum.  This  vxll  indicate  hov  sensitive  the 
function  is  to  small  changes  in  each  a?  the  con* 
trol  variables  as  well  as  pointing  out  possible 
regions  of  instability  which  may  be  ianodlately 
adjacent  to  the  extremua;.  ‘ 
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5.0  Applications 


In  thlB  chapter,  w«  will  attempt  to  show  how  the  theories 

of  the  previous  three  chapters  can  be  put  to  use  to  solve  practical 

engineering  problems.  Three  jiroblema  were  chosen  as  exan^iles. 

The  first  (section  5.1)  deals  with  the  positioning  control 

of  B  typical  8*»coad  order  system  (rasas- sprlng-ds'^hpot).  The  random 

disturbance  has  a  damped -exponent  ial  ante  correlation  fuiiction  and  Is 

produced  by  a  first-order,  low-pass  filter  which  is  subjected  to 

zero-mean,  Gaussian  white  noise.  Acceleration,  velocity,  and  displsce- 

m  t  feedback  control  are  employed  and  the  oaxlnaiic  control  force  is 

limited  to  -  f’  . 

icax 

The  second  and  third  problems  both  deal  with  a  suboarlne  which 

l3  nmnlng  at  periscope  depth  ia  a  landora  sea.  In  the  second  example, 

the  optlml  roll  control  of  the  subaartne  is  determined.  The  power 

spectral  density  of  the  roll  forcing  function  is  calculated  from  the 

(32  3  3  34) 

UeuBJann  wave  hel^t  spectnua' '  ->-»»  o  /  f^om  submarine  geoaietry. 

A  control  with  five  variable  parameters  is  designed. 

In  the  third  problem,  the  coupled  pitch -heave  power  speetzm 
are  determined  In  a  fashion  similar  to  that  of  the  preceedlng  problem. 
T3ie  nine,  variable  parameters  of  the  control  system  are  specified  sa 
as  to  optimize  a  given  system  performance  criterion. 

The  first  exaiqple  was  chosen  to  coiqiare  the  Mhx -Banking, 
statist! caXly-equl valent  linearization  approach  to  another  method  which 
did  not  use  a  criterion  that  minimizes  some  function  of  the  error.  Tha 


purpose  of  tbla  cocipsrlson  nas  to  shov  that  the  Max-Rinking  Criterion 
can  accoB^llsh  the  end  goal*  of  other  criteria  which  necessitate  aore 
coagtlcx  oatheoatlcal  analyse*.  The  second  two  exao^tle*  were  chosen  for 
tMo  reasons.  First,  to  denonatrate  how  the  ime  of  the  technl(iuett 
developed  in  this  work  slsqpllfy  the  optlsixatlon  of  c(»plex  systiaBa;  and 
secondly,  t demonstrate  that  these  techniques  can  produce  practical 
results  for  real  problems. 

5.1  Three -Bsraaeter  Positioning  Control 

The  system  of  Figure  20  Is  a  positioning  control  which  has 
acceleration,  velocity,  and  displacement  feedback.  The  Input  distur> 
bance  Is  formed  by  passing  zero^taemn,  Gaussian,  white  noise  through  * 
first  order  lag,  or  low  pass  filter. 

{ 15 ) 

^Ails  was  the  system  us  >d  by  Broniwltz  to  cooigpare  the 
saturating  control  system  of  Newton^  ^  ^  to  the  "bang«bSLDg"  control 
systems  developed  by  Ba**^^^  and  Davl*^^^^.  (Bass  and  Davis  both 
used  Lyapunov's  Second  Method^^^'  to  ootain  the  switching  functions 
which  produce  a  mlniiaLa  mean  square  error. )  Hewton  deveXojed  a  method 
for  minimizing  the  mean  square  error  of  a  zystem  subject  constraints 
on  the  tafimn  square  values  of  one  or  more  of  the  system  varlableit  (see 
section  2.1.3).  A  solution  was  obtained  by  using  Lagrange  Multiplier 
and  Calculus  of  Variations  techniques.  Broniwltz  applied  Hewton 's 
method  to  a  second  order  system  and  obtained  the  control  shown  in 
Figure  20  with  the  control  parameters  and  Kl.  For  a  oaring 
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Best  Available  Cop\ 


ratio  (C)  e<iual  to  0.2,  =  ua^  =  lOCO  rad/s^'r.,  and  the  Lagrange 

Multiplier  which  produced  the  beat  results  ( *  0. l),  the  C'aritiol 

parameters  for  Newton's  control  were: 


-  1.71, 

=  5.53. 

»  8.00. 

Brcniwltz  then  ran  this  system  on  an  analog  computer. 

Unfortunately,  he  only  determined  the  two  ratios:  (a^  /^y-  ) 

(F  /a^  )  at  three  values  of  (F  /a  )•  The  terms  in  these  ratios 
'  max'  '  max'  n' 

are  defined  as: 


the  r.m.s.  value  of 


he 


'max 


-  the  r.m.s.  value  of  X_,  when  F  is  zero, 

u  max  ' 

-  the  maximum  allowable  value  of  the  control 
force  (Xp/uj^ ) , 

-  the  r.m.s.  value  of  X^, 


n 


-  the  r.m.s.  value  of  (N/u^) 

Thus  it  was  necessary  to  determine  values  for  ,  and  a 

before  comparing  the  two  criteria. 


Y  f  V'y' 

A  ^  ^ 


\  n ! 

\  v  C4a  . 
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it  was  decided  to  make  the  calcrulatione  on  the  digital  com¬ 
puter  uDlng  the  eqiii valent  linearltation  technique.  This  also  alloas 
\i&  to  coiEpare  Some  of  the  results  from  the  equivalent  linearization  with 
the  analog  results  o?  Bronlwltz.  Digital  computer  calctilatlono  were 
made  fji  several  values  of  The  results  are  shown  in  Figures  21 

and  22 . 

The  agreement  here  la  quite  good  when  one  considers  that  one 

of  the  thr  e  feedback  loopa  passing  thi-ough  the  uonllnearity  is  an 

algebraic  loop  with  a  loop  gsln  of  -  l.Ji  This  causes  the  signal 

at  the  Input Ito  the  nonlinearity  to  be  appreciably  distorted  for  all 

values  of  F  ^/cy  less  than  2  or  3>  which  la  contradictory  to  the 
1 

basic  assumption  that  X,  is  Gaxisslan.  The  difference  between  Booton'a 

method  and  th?  first  method  of  Kazakov  isaaall,  althou^  Booton's 

method  is  better  in  this  case. 

Three  system  variables  are  used  in  the  optimization 

2 

criterion.  These  are  the  mean  square  acceleration  (o„  ),  the  mean 

2  ^^2 
square  displacement  (9  ‘')  and  the  -aean  square  control  force  (o^  ). 

Results  were  obtained  for  three  different  Max -Ranking  Arrays.  They 

are  shown  in  Tnble  3. 

Array  nvunber  1  was  chosen  to  illustrate  equal  enqphasis 
between  the  three  system  variables.  Arrays  2  and  3  should  acc<mpll8h 
the  basic  objective  of  Hewton's  method,  that  Is  to  minimize  the  mean 
square  displacement  while  fixing  an  upper  limit  on  the  aean  sq^ure 
value  of  the  ccmtroj.  force.  The  two  Halts  were  taken  from  the  x^ults 


Flfurv  21 


Coiwrl»Q«  of  Distal 


wit'll  tfc>  AaftloK  Sliittlon 


rlson  of  Result 


Table  3 

Max -Ranking  Arrays  for 
Sxastple  1 
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obtained  using  the  control  parameters  detf.nrJ.ned  by  Bronlvltz. 


A  computer  prcgrsun  was  written  to  optimize  this  system  for 

each  of  the  three  Max-Ramclng  Arrays.  A  linearized  approach  was 

taken,  with  the  direct  evaluation  of  the  third  order  equations  as 

(20) 

presented  in  Newton,  Qould  »r*d  Kaiser'  A  three-dimensional  rexidom 

search  was  used  to  determine  the  three  control  pa,rameter8.  This 
digital  comput'-r  program  I  s  included  In  Appendix  A-2  to  show  the  sim¬ 
plicity  and  brevity  of  this  approach.  A  sufficient  number  of  ccorent 
cards  (distinguished  by  the  C  In  the  first  colunn)  are  included  to 
explain  the  logic  and  mnemonic  coding. 

Tae  results  of  these  optimizations  are  shown  In  Table 

Array  1,  which  specified  that  ail  three  vurlablee  were  of  equal  impor- 

2  2  2 

tance,  produced  a  filial  result  with  9^  -9^  =9^  «  1.3?.  Array 

^A  H  ^ 

2  and  3  essentially  duplicated  the  results  obtained  using  Newton's 
Method,  thus  accompi '.shing  the  major  purpose  of  this  example.  Tuis 
shows  that  the  simple  approach  offered  by  the  Max-Banking  Criterion 
can  accomplish  the  same  end  goa.'s  as  other,  mor»  complicated  methods. 
At  the  same  time,  it  never  forces  the  designer  to  choose  values  for 
wei^itlng  functions  or  Lagrange  Multipliers  which  have  little  or  no 
physical  relationship  to  the  actual  problem. 


5.2  Control  of  Ship  Motions 

Before  going  on  to  the  two  specific  problema  to  be  dlscusoed 
in  this  section.  It  Is  necessary  to  first  provide  soma  of  the  background 
information  In  this  field.  A  large  number  of  papf^s  hav'e  been  written 


Control 

>4 

* 

2 

2 

% 

2 

2 

T 

Max-Ranking 
Arrty  i 

S .  0 

.73 

.98 

•  73 

•  999 

■ 

1.35 

■ 

■ 

N'jwt.'r. ' s 

■ 

') 

2.77 

4.x 

.  694 

.153 

3.17 

.153 

Max-Raaklng 
Array  2 

1 

^  .  C  4 

.  .-9l* 

3.775 

.  5  00 

.541 

.154 

3.17 

,129 

Newton  ' 

1.71 

8.x 

.263 

.c46 

3.86 

.048 

Max -Flanking 
Array  3 

5.0 

1 _ 

y  *  y  J 

7-78 

.999 

.277 

.046 

3.86 

.OUT 

K„,  ‘was  detenained  by  Mt-thu'-. 

£** 


Tabi  + 

Comparison  ol'  ^tex -Ranking  Method  with  Newton’s  Method 


on  the  response  and  control  oT  a  ship  or  subnarlne  In  the  sea.  Somi 
of  the  more  Inpor+ant  works  are  listed  in  references  39  to  Mt. 

Until  the  laBt  decade,  almost  all  of  the  work  was  done  ba&ed 
on  a  "regular  "  sea,  that  Is  one  which  le  perfectly  sinusoidal. 

Recently,  people  became  Int^ree^ad  Ir.  u«rt«.rTaiaiaj[  the  statistical  pro¬ 
perties  of  a  random  sea.  Many  wave  height  measurements  were  recorded, 
but  no  general  correlation  was  obtained  until  Heiaaann  arrived  at  a 
fonnula^^  -3**)  y^lch  describes  the  power  spectra  of  a  fully-arisen  sea 
as  a  function  of  the  wind  ve  oclty  (V  )  and  the  slilp's  hesuilng  ). 


0 

T 

uu 


P  P 

•(2g^/^V) 


cos 


(30) 


The  pSLramcter,  is.  Is  the  wave  frequency  and  is  a  constac,t  equal 
2  5 

to  32,9  ft.  /sec,.  This  represented  a  gi^itlc  step  forward.  However, 

the  problem  of  deteraining  the  tnanafer  function  between  the  sea  spectnia 

and  the  force  and  moment  Input  to  the  ship  still  remains  to  be  solveo. 

Thus  far,  this  can  only  be  done  for  mathematically  sliqple  shapes  such 

as  ellipsoids  and  spheroids. 

(U5) 

Havelock'  '  has  developed  the  equations  to  determine  tho 
heaving  force  and  pitching  moment  of  a  prolate  spheroid  submerged  In 
a  regular  sea.  Aasunlng  that  the  shape  of  a  submarine  can  be  approx¬ 
imated  by  a  prolate  spheroid,  it  is  now  possible  to  determine  the  power 
spectral  density  of  the  pitching  and  hearing  forcing  function.  The 
process  Is  shown  In  block  diagram  form  In  Tlgure  23. 


bk 


Con 


)\/ 
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Figure  23 


The  operation  (  ^u»)  represents  the  apparent  frequency  shift  in  the 
Lies  speotruRi  due  to  the  fact  that  the  submrine  Is  moving  with  respect 
to  the  sea.  Tlie  Inunction  d(uj  )  represents  the  attenuation  due  deptli 
for  waves  -^f  various  ■frequencies.  The  t>  nr,  C,  C(ju  )  “itkl  C  ((»  ) 
are  the  transfei-  functions  deve-ioped  by  rtave.locJi:. 

The  frequency  shift  x)  can  oe  detemslned  quite  readily. 

The  speed  of  propcgatlou  of  a  wave  (c)  Is  only  a  function  of  Its 
wavelength 


2 

c 


(31) 


The  frequency  of  this  wave  as  observt'd  by  a  statloriary  object  is: 


(32) 


The  frequency  of  this  wave  as  observed  by  an  object  which  Is  moving 
at  a  velocity  j.n  the  direction  directly  opposite  to  the  wave  pro- 
pogatlon  direction  (♦^  -  0)  la: 


•"s  *  T  ^ 

Combining  equations  (3l)>  (32),  and  (33)  gives  a  direct  relationship 
between  the  sea  spectrum  frequency  (»)  and  the  frequency  observed  by 
the  submarine  (uj  ), 

3 


VoW 

®8  "  ~ 


(34) 
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Thi*  x*el%tlonBhlp  allows  the  povtr  spectral  density  of  the  ae*  to  be 


!  xpreaaf'd  as  i  function  of  the  frequency  m  .  Rentsmberlng  that, 

B 


dUo  ■ 


(35) 


the  new  power  spectral  density  is, 


(36) 


The  depth  attenuation  of  the  effects  of  the  various  frequency 
waves  Is  expressed  as, 


(37) 


where  d  is  the  depth. 

HavelocK  determined  the  functions  C  (<«  )  and  C  (jj  ) 

z  3  yy  s 

to  be, 
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v^j,er« 


4 


C  im  ) 

yy' 


)»  J3/2(  )  «nd  atandard  BaaaeX  functlona 

L  la  the  length  of  the  ajiierold  •  2m 

Ig  and  K'  the  axial,  tranarerae  and  rotaUcttial 
virtue*  inertia  coefflclenta 

«  la  one-half  the  length 

b  la  one-half  the 

B  la  the  length  to  uea«  wkUo  •  aA 

/I, 


'/  A  (O 
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e  la  the  eccentricity  «  (l 
13ie  edditional  tvo  conatants  C  ^  and 


Cg  are  defined  aa, 


"5  "  «/  • 

r.  ^  .2  , 

C2-jTTgj»abL, 


(^0) 

(^1) 


where  .f  3  the  water  density, 

Iheae  relatlonshlpa  were  combined  numerically  to  produce  the 

power  spectral  denaltiea  H^(»  )  and  H  ^(a»  )  shown  in  Figures  2k  and 

2 '  B  yy  '8 


25. 


The  above  relatlonshlpa  developed  by  Havelock  cannot  be  uaed 
for  roll  calculations.  Therefore,  for  the  sake  of  expediency  in  deter¬ 
mining  the  roll  spectrum,  it  is  assumed  that  the  body  is  square  in 
cross  section.  For  this  case,  it  is  also  assumed  that  the  sea  is  coming 
from  directly  abeam  (^he  worst  case)  and  that  is  zero.  This  pro¬ 

duces  the  approximate  power  density  spectrum  shewn  in  Figure  26. 

In  order  to  be  of  any  value  in  a  linear  analysis,  these 
approximate  spectra  must  be  now  approximated  by  some  type  of  linear 
filter.  A  second  order  filter  of  the  type, 


2 


(42) 


F(s) 


s  4  ^ 


Ci 


was  tried.  Two  filters  are  compared  with  the  hoava  power  density  spectrum 

In  Figure  24.  The  filter  which  seta  TV^,  eq\;ai  to  zero  appears  tc 

provide  the  Lest  model.  The  filter  with  T^,  ■  Tl  was  shown  also 

Ci 

beeaiis*’  It  has  a  special  characteristic  that  r one  people  feel  Is 
l;r.portant.  This  Is  the  fact  that  the  autoccrrelati jn  furctlon  of  this 
filter  output  Is: 


Ry(T)  .  Cy 


li 

T- 


It! 


cos 


(^3) 


when  the  Input  to  the  filter  is  white  nol3>'.  It  has  been  generally 
suggested  that  the  autccorreiatlon  function  of  the  ship  disturbances 
could  be  best  approxiirated  by  an  exponentially-damped  cosine  fu.ictlon. 
It  would  be  of  interest  to  compar"  the  output  autocorrelation  functions 
resulting  from  these  two  different  filters. 

For  this  study,  the  first  filter  (T).^  «  O)  was  used  e  s  an 
approximation  for  all  three  forcing  functions,  (Tills  filter  produces 
a  disturbance  autocorrelation  function  which  is  the  exponentlally- 
dimped  sum  cf  si.ne  and  cosine  texTns.) 


Availabi 


es 
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■  I 


1 


The  rf*ductlon  of  rship  notions  Is  certalaly  not  a  nev 

subject '  .  However,  It  has  only  been  vitliin  the  past  few  years  that 

people  have  become  concerned  with  the  optimal  control  of  ship  motions . 

As  in  rtany  other  fields  of  control,  th'  emphasis  has  been  placed  on 

(■^7) 

minimizing  the  mean  square  displacement.  7or  instance,  Davis'"  has 
shown  that  the  minimum  mfAn  square  error  criterion  leads  to  the.  "bang-- 
bang"  control  of  all  control  aurlaces.  He  then  went  on  to  determine  tr.e 
switching  criteria  for  this  type  of  control.  One  only  need  envision  a 
nodem  airci-aft  carrier  sailing  out  to  sea  with  Its  rudder  flailing 
back  and  forth  between  its  stops  to  wonder  if  it  is  really  desirable  to 
minimize  the  mean  square  error.  In  the  next  two  sections  we  shall 
attemp''  show  that  practical  optimal  control  can  be  designed  uclag 
the  Max -Fanning  Criterion. 


5.2.1  Submarine  Roll  Control 

The  Trolling  action  of  a  submarine  can  be  modeled  quite 
effectively  as  a  simple  second  order  system.  This  is  because  roll  is 
Bo  li^tly  coupled  to  the  other  five  degrees -of -freedom.  'Hie  system 
with  roll  control  is  shown  in  Figure  27. 

The  nomenclatur*  which  is  used  here  agrees  with  that 

(46) 

iccepted  by  !Bie  Society  of  Naval  Architects  and  Marine  Engineers'  *•. 

-  moment  of  inertia  about  the  roll  axis 

K.  -  virtual  moment  of  inertia  about  the  roll  axis 
P 

X.  -  roll  acceleration 
P 

X  -  roll  velocity 
P 
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Ficur*  26 


Uhlty  Aa|>lltud« 

Wol  — 


RoU 

I>lsturb«ae« 


roil  anglr 


B  -  buoyBncy 

2^  -  rr.»'tao>Titrlc  height  (muat  b*:-  negative  for  stability) 

-  r\-ll  danping  (must  b--  ne^tlve  fjr  stability) 

Values  whioh  urv  typ)l'-'al  for  moderr  submarines  are  used, 


I  S  3  X  10^  Ibm-ft^ 

X 

c  P 

K.  -  -  3  X  1C  Ibm-ft 
P 

BZg  *.  -12.5  X  IC^  Ihm  ft'^/etc^ 

K  s  -lO^lbtn  ft"/'sec 

P 

From  FlfniT"  26,  input  disturbance  Is  lojdeied  by  a  ijnity 
amplitude  unite  noise  source  and  a  second  order  filter  as  shewn  in 
Figure  28. 

The  'mlues  determined  for  the  coefficients  are: 

S  “  6,0k  X  10*^  Ibm  ft^/sec^ 

o 

7^  =  .73  rad/sec 

T]^  3  .438  rad/sec 

The  control  system  chosen  Is  about  as  general  as  Is  desirable. 

Provision  is  made  for  acceleration,  velocity,  displacement,  and  Integral 

displacement  feedback.  The  lag  in  the  control  path  models  the  movement 

of  the  control  surfaces  in  response  to  command  signals.  The  variable, 

X  ,  is  the  time  rate  of  change  jf  the  control  moment,  X  ,  and  therefore 
cp'  ^  '  cm 
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is  •  measxire  of  lDStant«meou«  control  power.  The  saturstlon  nonlinearity 

Beiges  to  limit  the  control  moment  (X  )  to  «  naxloum  value  of  and 

cm  3 

ale  )  r*  atrlcts  the  control  power  (X  )  to  a  naxlnum  value  of  2K^K  . 

'  cp  3  c 

When  the  nonilneaarlty  Is  replaced  by  the  equivalent  linear  gain 
the  five  contr  )1  parasjeteru  are  then  defined  as  : 


-’btir  system  variables  are  used  in  the  optimization  criterion. 

These  are  the  roll  acceleration  (X. ),  the  roll  angle  error  (-X  ), 

P  9 

the  control  moment  (X  )  and  the  control  power  (X^  ).  The  Max> 

cm  cp 

Ranking  Array  which  was  \ised  is  shown  In  Table  5. 
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(imd/aec^)^ 


2 

9 

(rad)^ 


°X 

cp 

( )** 


em 

2  ,  2, 


(iba-ft  /iec  ) 


6.1*8  X  lO"^  3.04  X  lO”^ 


2  2.59  X  lO"^  i.22  X  10*^ 


9  X  10-^ 


1.6  X  10^^ 


6,4  X  10 


3  1.04  X  10*^  4.87  X  10“^  4.9  x  10^^ 

6.48  X  10‘^  1.49  X  2.56  X  10^^  1.03  x  10^ 


5  2.59  X  lO'^  3.04  X  10"^  4.10  x  10^’'^ 


4.10  X  10^”^ 


2 


(the  maximum  radius  of  the  submarine  hull);  **  equal  to  1.22  x 

-3  2  ^ 

1C  rad  corresponds  to  an  r.m.s.  roll  angle  of  2  degrees;  Oy 

equa..  to  6.4.  x  IC"^^  Ibn-ft  /sec  is  thf  moment  required  to 


cm 


correct  a  2  degree  list  of  the  subo^rine  or  to  produce  a  .025  rad/sec 

2  14 

angular  acceleration  of  the  body;  eq;ual  to  9  *  IC*  corresponds 

*cp 

rou^ly  to  the  ability  to  move  the  control  surface  from  the  zeno 

position  to  the  position  which  produces  the  riean  sqmre  moment 
2  15 

(Oy.  =  6.4  X  1C  )  Ir.  three  seconds, 
cm 

The  loot  row  In  Table  5  -a^  p’^'^:scly  made  unrcallsticeliy 
high.  This  allows  some  measure  of  comparison  during  the  early  phase 
of  the  search  when  the  mean  square  valines  are  apt  to  be  high.  If 
this  row  were  not  present,  the  selection  process  would  discard  all 
systems  which  produced  any  values  greater  than  those  contained  In 
row  J(l)  ■  5*  This,  in  e.ffect,  discards  ir*fontaatiQn  which  Is  of  value 
to  the  search  procedure  and  thus  decreases  the  efficiency  of  the  search. 
This  added  row  caono't  confuse  the  end  results,  since,  for  this  case, 
any  value  of  J  greater  than  5  is  readily  recognized  as  an  unacceptable 
system. 


The  digital  computer  program  for  the  problem  was  written  using 


eq’oivalent  linearization  and  algebraic  evaluation.  This  program  is 


Included  In  Appendix  A. 2.  It  should  be  noted  that  required  computation 

I  I 

I 

for  this  sixth  order  system  Is  considerably  longer  than  for  the  previously 


discussed  thlixl  order  system,  however,  the  search  procedure  and  the  use 


of  the  Max-Ranitlng  Criterion  are  essentuilly  unchanged. 


This  program  vas  run  several  times  with  varying  values  of 
.he  i  earrh  exponent  (m).  After  the  first  two  short  runs,  It  was 
ibvlous  tiiat  the  Integral  control  term  (K^)  should  be  zero.  The  renain- 
ng  runs  were  jade  with  only  a  four  parameter  search.  The  results  of 
hese  runs  are  listed  In  Table  6. 

The  presence  of  Kj  as  a  search  variable  lengthened  and 
ompllcated  the  procedure.  Tlie  reason  for  this  Is  the  fact  that  there 
s  only  a  narrow  range  of  values  of  which  yield  a  stable  system. 

Igure  ^  shows  this  for  the  region  near  the  minimum  snd  also  points 
It  the  fact  tnat  K^,  i  hould  be  eq-jal  to  zero  for  best  reaults. 

In  rtins  number  one  and  two,  only  25  to  30  percent  of  the 
)t*l  choices  were  stable.  Setting  equal  to  zero  Increased  the 
•action  of  stable  points  to  around  This  J  still  a  low  pereentage, 

'.d  it  suggests  that  either  a  high  percentage  of  the  search  space  is 
stable,  or  a  large  portion  of  the  search  is  being  carried  out  in  the 
clnity  of  an  unstable  region.  Figure  31  shows  that  the  value  of 
ich  produces  a  minimum  is,  in  fact,  directly  adjacent  to  an  unstable 
glon. 

All  six  runs  were  within  less  than  2%  of  the  lowest  value 
rather  widely  scattered  values  of  the  control 
rsimeters  were  obtained.  Runs  three,  four,  and  five  produce  close 
*eement  and  are  all  obviously  near  the  same  islnioiiai.  Runs  one,  two 
I  six  may  be  apparadchirig  this  same  minimum,  but  the  searches  would 
’e  to  be  continued  to  be  siure. 
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*^BlniJBUD 

.6^5 

.676 

J(l) 

.665 

.676 

J(2) 

.233 

.245 

J(3) 

.667  i 

.675 

J(M 

.049 

.050 

10^ 

A 

4.44 

4.38 

4.5a 

4.63 

^  X  10^ 

*D 

7.23 

7.43 

»  *  X  1(3^3 

*CT 

7.89 

8.01 

X  10"^3 

6,77 

6.75 

*CP 

X  10^ 

4.93 

4.24 

*A 

5.20 

8.05 

s 

1.03 

-.009 

*D 

-.557 

-.919 

.007 

.009 

*0 

.085 

.055 

709^  Compute - 
tlon  time  (min) 

•i.5 

-1.5 

Exponent 

_ 2 _ 

_ L- 

.666 

.670 

.666 

.670 

.226 

.229 

.227 

.237 

.669 

.666 

.666 

.670 

.060 

.060 

.060 

.055 

4.31 

4.32 

4.31 

4.35 

4,38 

4.41 

4.39 

4.50 

6.86 

6.95 

6.89 

7.21 

9.58 

9.62 

9.60 

8.71 

6.69 

0.66 

6.66 

6.70 

.430 

.421 

.417 

1 

.483 

1.99 

1.9c 

1 

1.97 

3.39 

.310 

.248 

.279 

.125 

-.976 

-.951 

1 

—  fixed  at 

1 

.170 

-995 

-.911 

.165 

.164 

,!’4 

1.4 

^1-6 

*^1.3 

-1.2 

3 

5 

7 

7 
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The  region  around  the  point  detennlned  by  run  fire  vas 
examined  and  the  x*e8ulta  plotted  In  Flgurea  29  throu^  33*  Thla  fora 
of  cooqputer  printout  tuma  out  to  be  more  ufeful  than  it  uaa  first 
thought.  It  provea  to  be  an  effective  check  on  a  nuaber  of  lt«as. 

First,  It  pro  idea  absolute  proof  that  a  alninai  has  bean 
reached.  It,  of  coxurtte,  does  not  prove  that  this  is  the  true  Blniasai 
and  not  Just  a  relative  minlinum. 

It  can  point  out  regions  of  instability  near  the  design  point. 
This  is  particularly  helpful  Information,  since  any  control  in  ehlcb 
small  changes  In  a  control  parameter  could  cause  instability,  is  not 
practical,  let  alone  optimal. 

Similarly,  these  figures  indicate  the  senal^ Ivlty  of  the 
system  to  changes  in  the  Individual  pamaicters.  Thla,  certainly.  Is 
also  of  Interest  to  the  designer. 

Finally,  it  provides  a  check  on  the  accxiracy  of  the  eosqpu- 
tatlonal  process.  Inaccxiracles  caused  by  round >off  errors  vlll  add  a 
certain  amount  of  scatter  to  the  resxilts. 

Figures  29  through  33  shov  that  the  searching  process  vaa 
sxtremely  accurate.  The  only  control  parameter  vblcb  is  iu>t  vlthln 
1%  of  the  actual  minimum  is  Xy.  (Figure  30).  This  is  certainly  excua* 
ible,  since  a  -  I0)(  variation  in  produces  only  a  change  in  the 
nlninuffl.  It  shotild  be  pointed  out  that  the  search  results  obtained 
lere  are  several  times  more  accurate  than  are  required  In  practlxsc.  The 
learcbes  vere  lengthened  for  these  studies,  since  searching  procedure 
.as  also  of  intereet.  ' 
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Figure  31  sbovs  that  the  rlnlmum  is  Innediatel/  adjacent  to 
a  region  of  Instability.  Bcwerer,  It  also  sbovs  that  the  control 
parameter  can  be  reduced  by  lOjt  vhlle  only  reducing  the  system  per¬ 
formance  by  2.3^*  Zf  this  is  not  desirable,  an  alternative  is  to  fix 

X  at  some  level  (iuch  as  O.90)  and  run  a  new  three  parameter  search. 

D 

2 

Using  thrt  values  of  a-  and  Xj.  In  ccluasi  four  of  Table  6, 
we  can  now  express  the  gain  (see  Figure  2j)  as  a  function  of  the 
saturation  limits,  -  Ky  This  was  obtained  from  Figure  6  using 
Booton’s  method  of  equivalent  linearization.  The  resiilts  are  shown 
In  Figure  -U. 

Finally,  it  la  of  interest  to  sje  what  affect  the  ncfw  control 
system  has  on  the  behavior  of  the  system.  This  can  be  seen  to  a  cer¬ 
tain  extent  by  examining  the  denominators  of  the  controlled  and 
uncontrolled  systema.  Uie  uncontrolled  system  has  a  denominator  e<{ual 
to. 


2  2 
3  «s  2  C  s)  s-fm 
u  'u  nu  nu 


#here 

-  0.174,  and 

<i)  *  ,bj  rad/sec 

From  Figure  26,  we  see  that  this  la  only  sll^tly  hif^er 
han  the  treq^tiency  corresponding  to  the  smxlnwnn  input  moment  («>■  .74 
ad/sec).  The  controlled  systai  has  a  denominator  of. 


-  ice  - 


fljur*  ik 


Gain  (Ky)  BM  »  ruaetlop  of  Llalt  (K-^) 
Unif^  BQOtoo*n  Aggrcalintloa 


»3 


-  IC3  - 


(■  ♦  «l)  (•  ^  ®  V  “  ■"  ^ 


(^5) 


0^  -  .tOC;T  r«d/8?^c., 

*  .387,  «nd 

C 

d,  ■  .5^  rmd/sec 

nc 

j5,  the  control  adds  a  nev  pole  at  «  «  .0007  md/aec.,  shifts  the 
ural  frequency  to  .92  rad/sec.  and  increases  the  dainplng  ratio  tram 
4  to  .387.  Each  of  these  hare  the  effect  of  reducln^g  the  resp^e 
the  system  to  an  Input  spectrum  of  the  form  of  Figure  26. 

.2  Submarine  Pitch-Heave  Control 

The  vertical  motion  (heave)  and  the  vertical  rotational 

Icn  (pitch)  of  a  auhJcurlne  are  very  clonely  coupled.  25xu*,  it  1« 

practical  to  attetqrt  to  independently  control  these  Motions • 

ure  33  shovs  the  coupled  pitch-heare  system  vlth  the  assoelatad 

trol  system.  The  nomenclature  \ised  here  asreea  vlth  the  BMAHl 
(1*8^ 

Dmmendatlons '  ' : 

w  -  heave  acceleration 

w  -  heave  velocity 

• 

-  rate  of  bhange  of  d^Ah 
2  •  depth 

.  dealred  dejifih 


lot  - 


Pl«ur«  35 

Pltck-lMw«  Control  ot  •  ‘hitirlM 
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w 


Z.,  Z 

4  q 


M. 
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M. 


B 


depth  error 
pitch  acceleration 
pitch  v*-'loclty 
pitch  angle 
deslr^-d  pitch  angle 
pitch  angle  error 
etem  plane  force 
stem  plane  pcver 
bow  plane  force 
b'^  pleme  powe” 
heave  disturbance 
pitch  disturbance 
submrlne  oass 
virtual  raass  In  heavlnt, 
heave  d.’naplng 

coupling  coefficients  relating  pitching 
acceleration  and  velocity  to  he«vlj:g  forces 

moment  of  inertia  in  pitching 

virtual  moment  of  Inertia  in  pitching 

pitch  dancing 

total  submarine  buoyancy  (eq.ual  to  mg  for 
neutral  buoyancy) 

metacentric  height 

coupling  coefficient  relating  heaving  acceleration 
and  velocity  to  pitching  momenta 


-  106  - 


distance  from  the  bow  planes  to  the  center 
ol  gravity 


distance  from  the  stem  planes  to  the  center 
of  gravity 


V 


o 


submarine  forward  velocity 


K^to 


control  parameters 


There  are  three  saturating  nonllnearltles  In  this  system. 

The  one  which  limits  the  desired  pitch  angle  will  behave  almo.’t  linearly 
for  this  type  of  disturbance.  The  purpose  of  this  eli-ment  Is  to  prevent 
the  desired  pitch  angle  from  exceeding  the  specified  safety  limits 
during  sudden  large  changes  in  the  desired  depth. 

The  stem  plane  euid  bow  plane  control  loops  with  their 
associated  limiters  are  Identical  to  the  control  loop  employed  for  the 
roll  control  of  the  previous  s^-ctlon. 

Tlie  phlllsopliy  behind  this  type  of  oubmarine  depth  control 
is  that  changes  in  depth  can  be  more  easily  accomplished  by  changing 
the  submarines  emgle  of  attack  than  by  attempting  to  maneuver  it  up 
and  down  with  bow  and  stem  plane  forces. 

The  system  values  chosen  for  this  study  are; 


7 

m  =  4  X  10  Ibm. 

=  -  3*5  X  lo’^lbm. 

=  -  8  X  10^  Ibm/sec 

Q 

Z,  =  -  4  X  10  Ibm-ft 

4 
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»  -  8  X  10®  Ibn-ft/sec 

ly  =*  3  X  10^^ 

-  “  2.5  X  10^^  Ibm-ft^ 

»  -  2  X  Ibffl.ft^/aec 

Q 

®  -  4  X  10  Ibm-ft 

Q 

Hy  =  3  X  10  Ibra-ft/sec 

BZg  =  -  2.5  X  10^  Ibm-n^/aec^ 

Lg  *  200  ft. 

Lg  =  100  ft. 

V  =  40  ft/sec 

Thf  Input  dlsturosncea  v.re  calculated  prevloualy  In  thla 

.apter  and  are  ahoun  In  Figures  24  and  25.  The  nnxiel  used  In  ehovn 

I  Figure  36. 

This  type  of  node!.  oorapUcatea  the  future  celculatlors 
mevhat,  because  the  tuo  Input  disturbance,  are  not  statistically 
dependent.  Thus,  the  system  output  density  spectra  are  dependent 

on  the  tvo  input  cross  pover  density  spectra  as  veil  as  the  tvo 
to  power  density  spectra. 

The  values  determined  for  the  coefficients  of  these  Input 
Lters  are: 

’  1*775  X  lo"^  Ibm-ft/sec^ 

■  *515  rad/sec 
«  1.03  rad/sec 

1)22  -  5. IT  X  10^  Ibm-ft^/sec^ 


F 


,.p  h 


-iurc 


-  100  . 


665  r«d/Bec 


1)^  -  1.33  r»a/.ec 

Eight  system  variables  vere  used  In  the  construction  of  the 
oc -Ranking  Array  (Table  7).  The  value®,  selected  for  the  arra:  are 
Millstlc  specifications  for  present  day  submarines.  As  In  the  pre- 
Lous  exanqple,  the  final  rov  vas  sBde  very  high  to  assist  the  search- 
ig  process. 

The  derivation  of  the  nunerous  tenth  order  transfer  functions 

sr  this  system  vas  a  monunental  algebraic  task.  ProvlslonB  vere  made 

Dr  calcula!;lng  the  mean  sqvjare  values  for  tvelve  system  variables. 

Q  addition  to  the  ei^t  vhlch  occur  in  the  Wkx-Rnnklng  Array,  values 
2  2  2  2 

Dr  ,  0^  ,  and  vere  also  determined.  It  la  suggested  that 

or  future  vork  of  this  size,  serlotis  consideration  should  be  given  to 
imulatlon  techniques  vh3,ch  require  l^jss  algebraic  manipulation  but  im)re 
omputatlon  time,  or  formula  manipulation  machine  languages  ouch  as 
ORMAC  (sm  experimental  Fonaula  Mwalpulatlon  Compiler  currently  being 
eveloped  by  the  IBM  at  the  Boston  Advanced  PrograimBlng  Department. } 

The  Fortran  Conputer  program  vhlch  vas  vrltten  for  this  pro. 
lem  is  listed  in  Appendix  A. 2.  The  search  and  optimization  procedures 
re  essentially  the  same  as  for  the  other  two  examples. 

Finite  difference  integration  \ised  to  evalxsste  the  mamn 
quare  values,  in  contrast  to  the  direct  algebraic  evaluation  used  lit 
he  other  tvo  exaioples*  This  vas  required  because  of  the  inacettxmey 
arrled  by  round  off  errors  in  the  algebraic  approach  (aee  Section  3.3.2). 
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Av; 

a  II**  f. 


or  this  ca3*,  finite  a.fference  integration  i»oriced very  veil.  Since 
Dth  Input  pover  spectra  are  narrov  band.  It  was  only  necessary  to 
mluat'-  the  integral  over  the  majciinuin  range  of  the  two  spectra.  The 
jsults  were  obtained  using  25  Increments  In  the  range  ®  ,6  to 
^  =  2.2.  A  check  on  the  accxiracy  was  made  by  Inoreasir.g  the  EFoaber 
*  increments  to  50.  This  caused  less  than  0.1^  change  in  the  mean 
imre  values  obtained. 

The  search  method  was  conducted  a  little  differently  for 
ils  large  system.  It  was  estimated  In  Section  3*3-^  that  approximately 
lOO  choices  could  be  evaluated  per  minute  for  a  iOth  order  system 
Ing  finite  difference  integration.  Equation  (43)  in  Section  4.3 
ves  the  estlmte  of  the  nvunber  of  choices  at  about  64, (XX)  assuming 
at  (N^)^  is  400.  This  indicates  that  it  would  require  about  one 
ur  of  time  on  an  IBM  7094  computer  to  produce  one  minimum  which  then 
old  have  to  be  checked. 

To  reduce  conqputatlon  time,  it  was  decided  to  s^art  several 
jgrams  at  different  locations.  They  were  run  with  search  exponents 
)  of  one  and  three.  EJach  of  these  programs  was  allowed  to  ritn  for 
)  minutes  which  is  equivalent  to  1500  to  2000  stable  choices.  The 
Jults  of  the  Initial  runs  were  compared.  Several  new  five  minute 
18  were  then  initiated  using  startixig  points  based  on  the  earlier 
:ult8.  These  decisions  external  to  the  con^niter  prevent  searching 
a  given  area  more  than  once  and  insure  that  no  areas  vill  be  como 
tely  neglected.  Using  this  method,  the  total  tine  required  con  be 
to  about  thirty  minutes. 


The  •eft.rch  •p»ce  tdalch  w**  iocliiile4  acd  tht'  final  r«mlta  of 
the  Bearch  are  llBtf*d  in  Table  8. 

The  r.o.*i  inearl  ties  ':»n  nov  be  reinserted  In  the  system.  The 
equivalent  ns  and  are  replaced  hy  and 

respectively  (see  Figure  35).  Figures  37  •nd  38  So  *so  •• 
functions  of  Sl 
in  Table  8.  Since  sill  be  about  3C  degrees  radians), 

vil?i.  be  eq-oal  to  .010  for  the  resirlts  obtained  here. 

The  ayatec  response  vas  again  calculated  In  tha  aele^ihorhood 
of  the  miniraum.  The  results  of  these  calculations  aie  shown  In 
Figures  39  throvigh  ^7* 

These  figures  show  that  the  search  results  were  again  more 
accurate  than  they  needed  to  be.  Unfortunately,  this  Infonaatloa  is 
never  known  until  '-fter  the  fact.  In  revj.ewlr.g  the  course  of  the 
search,  it  vae  detomilned  that  the  last  oce-thlrd  of  the  search  only 
produced  am  improvement  of  1.  In  the  system  performance.  Thltt  z\irther 
points  out  the  merit  of  first  performing  several  crude  searches  whan 
long  total  search  times  are  expected. 

Another  very  inqportant  fact  pointed  cut  by  these  figures  is 
t'jst  a  kf  change  in  any  one  of  seven  control  parameters  will  cause 
instability.  This  behavior  was  expected  after  an  early,  twoHalnute, 
purely  random  search  over  the  entire  search  space  showed  that  Qofi 
of  the  jnints  considered  produced  instability. 
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The  problem  of  moving  may  frca  this  region  (or  regions)  at 
’riotablilty  can  be  very  difflctilt.  If  ''ach  of  the  seven  troublesome 
•ontrol  parameters  is  moved  away  from  the  unstable  region  slnultaneouly, 
th'  n-  i.B  no  aeiJLi-a/"'  that  the  resulting  position  is  not  near  the  sasie 
or  another  unctable  c??gjyn,  since  nc  off -axes  positions  were  checlted 
for  ctiJbiilty. 

It  IS  doubtfiil  that  many  other  aine-pareuneter  optimal  con¬ 
trols  have  ever  beei:  designed,  “nierefore,  it  is  not  resuiily  apparent 
whether  this  instability  ccr^dltlon  is  universal  for  this  number  of 
parameters  or  If  it  is  Just  a  peculiarity  of  this  pertlculaur  problem. 

If  It  is  a  general  problm,  it  would  certainly  be  possible  to  test  each 
now  minimum  to  assure  that  it  is  not  within  a  given  proximity  to  a 
r-gion  of  instability.  This  could  be  accomplished  by  a  deteralalstic 
or  rendom  scan  of  the  surface  of  on  n-dlmenslonal  bypercube  which  ia 
centered  on  ohe  point  in  question. 

Again,  it  is  of  interest  to  examine  the  dexwmlnators  of  the 
transfer  functions  of  the  controlled  and  uncontrolled  systeae.  The 
uncontrolled  system  Is  xmstable.  The  denominator  of  the  transfer 
function  is: 

-  8(8  t  .01622)  (6  ♦  .0773)  (•  ♦  .3893)  i^) 

Ihe  control  system,  first  of  all,  must  make  the  system  stable.  The 
final  system  has  a  denomlns.tor  oft 


-18)  (e  ♦  1.70)  (i^  ♦  .097;  •  ^  -OlS) 


The  flrrt,  3<'Ccnd-ord>-r  tf-rr-.  hei;  an  undamp.-i  natural,  frequency  of 
.13^  r**.d/8ec  and  a  dairplng  ratio  of  .36i'-  This  is  well  below  the  prin 
clpal  disturbance  frequencies  (see  .Figures  2k  and  ^5).  The  u'-ccnd, 
second -order  term  has  an  undamped  nat'jj-al  frequency  of  605  rad/sec 
and  a  damping  ratio  of  .178.  This  Is  well  above  the  principal 
disturbance  frequenclea. 
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6.0  Concliaslons  and  R9coii2iieridation.s 


The  Max-Ranking  Criterion  proves  to  he  a  slinpie  bnt  -"Tecriv  ■ 
method  for  ’iieasnring  und  coc^sring  the  over-a3i  perforTriao  ■  f  r  “ 

It  can  he  readily  uBed  a8  a  perforrpnoe  Index  for  syoOens  s’Abp  et  d  ' 
either  stochastic  or  deterministic  dl3t-LU'bP’'ces.  It  also  has  vh  co-or' 
ity  to  be  used  as  an  index  of  perfonaance  for  a  vide  variety  of  oxh'  r 
systems  optimization  problems.  It  is  ia^iossibl  ^  *to  ptfcV'r?  ■-= 

Ranking  Criterion  le  che  most  general  form  of  an  optird zatior;  cr:t^  ri_n. 
However,  there  is  no  criterion  that  the  a\rthor  has  uncovered  in  th' 
literature  which  is  not  a  special  case  of  this  more  general  criterion. 

The  Max-Rsnking  Array  can  be  constructed  without  any  prior  know¬ 
ledge  of  the  internal  interactions  of  the  system.  The  designer  need 
only  express  his  specification  for  as  many  measures  of  system  response 
as  he  feels  are  important  to  the  over-all  system  performance.  If  th'- 
designer's  demands  on  the  system  are  unrealistic,  the  results  of  the 
optimization  study  will  point  this  out.  These  resiilts  can  then  be  uo  -d 
to  indicate  where  the  specifications  must  be  reJexed  if  a  vorkablt.  syst'i 
is  to  be  produced. 

The  one  disadvantage  of  the  Max -Ranking  Criterion  is  that  standard 
n^thods  of  calc\il\is  cannot,  in  general,  be  used  oo  determine  the  exoivor 
For  systems  above  and  5th  order,  which  reqiolre  sev'eral  parameters  tc 
determined  for  the  optimization,  this  is  not  really  e  disadvantag-  at  el 
At  this  point,  the  algebraic  coirplexitles  of  the  calculus  approach  b-?; oh 
overwhelming,  and  other  means  of  optimization  are  usually  ueed. 
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aie  criterion  can  be  readily  uaed  vith  either  am?i.og  <jr  dii:dt.ej.. 
con^ritation;  In  fact.  It  requires  less  digital  coisputation  time  than 
otter  njultlple-parameter  criteria  vhich  eniploy  vei^tlrg  functions. 

The  problem  of  determining  an  equivalent  linearization  ^in  does 
not  appear  to  be  difficult,  at  least  for  the  case  of  tbe  sat-orating;  el 
n«nt.  Booton’s  method  has  proven  to  he  acceptable  for  this  type  of 
nonlinearity  as  long  as  the  limiting  action  is  not  severe.  In  caseo  v 
the  nonlinearity  cannot  be  handled  in  this  fashion,  digital  cosi^nji 
simulation  can  be  used. 

On  of  the  principal  advantages  of  random  s^u^h  techniques  is  the 
ease  vith  uhich  they  can  be  applied  to  large-scale,  ccmqjlex  systess. 
present,  the  search  efficiency  of  the  sigqpler  methods  could  stand 
Imprcvment.  However,  the  efficiency  caan  be  5-nproved  if  one  is  willing 
to  accept  more  congjlicated  search  logic.  jHuch  more  can  be  learned 
about  the  general  behavior  of  random  search  techniques.  Some  question! 
which  have  not  yet  been  answered,  but  trhich  should  be  studied  in  tbe 
n«ir  future  are; 

1.  How  do  \jnallovable  (l.e.,  unstable)  regions  of  various  size 
affect  the  s^rch  efficiency  of  the  single  pereu^ter  search? 

2.  aDW  does  the  probability  of  finding  the  true  extressum  of  a 
naaltlmodal  function  vary  vith  the  relative  position  and  shape 
of  the  extrema? 
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3.  How  does  Bultldlmenslonallty  aiTCect;.  the  search  effeclencyt 

4.  Can  Large  laiprovenibats  in  search  efficiency  be  obtained  without 
sacrificing  too  much  prograamlng  sliiqpllulty? 

These  are  only  a  few  qixestlons  which  n»*ed  to  be  answered  In  the 
area  c  f  random  search  methods .  nilt  la  certainly  an  ax(;a  where  very 
little  practical  Infoiraatlon  is  available  at  this  tine;  It  Is  also  one 
where  modest  efforts  cotild  lead  to  alfplficant  Improvements  In  the 
general  area  of  optimization. 
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00  TO  no- 


C  COATIAvf  CAtswLATIHG  COrpriCpHTS  WHICH  00  HOT  OrPrUf)  UPON  AKIKI 

lAO  AOi-  ArAni«*2 
AI4I-  ETAi>a**2 
AIAI-  fTAlA 
Al  7|a  AIAI 
AIAI*  0, 


A|«)a  PTaII 
Al  13|.  FTAM 
Aim-  AIM 
A|  121-  A| )| 
Al  I  M>  AIM 
Al  1*1-  AIM 
AllM- 
Al  lAI- 
Aim-  A|4| 
Aim-  r»A;i 
A  I  23  I-  A|7) 


♦  f'TAl* 

•  AI-»  ♦  PTAll-»TA1* 

•  FTAi*  ♦  A|4|  •  PTA11 

•  AI4) 


j'  %  .I"--; 

i  .-‘'i 

M'"'" 


f'-'  ■ 

\  .--I.  'i  1 


TAl. 


A.U 


r»  r» 


1. 

.i  »•  AUJ  I 
*(*1  I 

ri7.2.II>  •(»!• 

CI7«2.2I>  t. 
r(*«i2»n«  Ann 
Cr**12*2l-  1. 

ClStAtU'  AOl  > 

Cl9t«*2l>  l« 
cn*9»n>  -1. 
cn*7»2t>  -Ai*n 
ETA’I*  rTA21»Am 
ETA22«  rTA22«An» 

C  CALCULATf  AKft  «TOtf  TmC  PO«r«^  Of  WA|H{  WHICH  A»r  U«rft  lAtrw  rM 

DO  17ft  M-ltHM 
Ga 

00  170  •«>2*« 

170  G»««M-n 

C  SET  IHJTIAL  rOHOITIOHS 

DO  inoo  lAa  1*  HIA 
lAaJA 

POINT  lAO*  ACCMAI.NLII  lAlfNEXIIAt 
lan  FONHATI  l»475XAHACC«Elft«7t*KNHNL7-t*l^lAHElP»*f  2///I 
•JMa  aONON,  ’ 

N1«  ft 
NJa  0 

00  200  I*  1*0 
Axnta  AKFin 
200  AxMtn*  Axrni 

NANOON  SfANCH  -  TH(f  fUST  •fWlT  TMP  INITlAt.  VAL'lTA  A»»  UAfft, 

THf  srCOMO  SFNItX  OE  CHOKES  CAN  *E  PUSELT  NANOOM*  THE  thINO  SEAfEA 
WILL  HAVE  the  exPONCNT  NfKPO,  THf  EINAL  fiNOUP  WILL  HAVE  tHC  EXPON'NT 
NEX*  The  UENGTH  OE  each  fiNOUP  EAN  AC  VANIEO* 

NEXPa  I 
GO  TO  712 
C  CHOOSE  AK(|| 

100  tEINS  -  N9LI  901*  i02*  109 

901  NEXP«  1 

TO  920 

902  NEXPa  NEXPO 
GO  TO  920 

909  :ffN9  -  NPit  920*  90A«  92fl 
10A  NEXPa  NPXIIAI 
120  00  990  t«  I*  NL 
!•  LKILI 

129  G*  PANNOEIAI 

AKin*  CXOlH*Ii,  •G.t.t*««PXP  ♦  AXHfTi 
IFtAXin  -  CXimi  921t  92Pt  12P 
72*  lEIAxni  -  r*2ll||  110,  910*  121  I 
990  CONTINUE 

C  HAVE  TOO  MANY  UNSTAPLE  POINTS  SfCN  OfTEMINPO 

lElNl  >  NS  -  NLCOP.  992*  100*  *00 
992  Nl>  N1  ♦  1 

CALCULATE  those  PARANETCPS  WHICH  OPPfNO  ON  AKfK|  mb  WHICH  APE  NTrilPO 
EON  STANILITv  CHECkINO 

-  1.XJ  - 


c 

c 


if  101- 

-A«(l  1 

0(111- 

-A* ( 1  1 

A  A«(9l 

0(21a  • 

•A*(ll  A 

AK(21 

0(70|a 

AOIll  « 

AKI91 

BfTlla 

AKIIl  A 

AI(9I 

01201- 

AKIAl  A 

AKIAl 

B(21|a 

All  91  A 

&«(A1 

8(901- 

(-AKAii 

A  AK (94  1  « 

11  A  OI7H 

0(91 1- 

1-0(201 

A  "(EMI  •  Alll 

aiAOl- 

uo  A  AK (1 1 

OfAOI- 

(-ALS  A 

AKIAl  -  ALO  A 

AK(9ll  A  A(9I  A 

•  (711 

»(A1 1- 

(-ALS  A 

•(701  -  AL"  A 

•17111  AAfSl 

0(721- 

•  nil  A 

A(A| 1  A  •(Al 1 

8(79)a 

•(All  ♦ 

Anil  A  01911 

0(7A1- 

•(901  A 

A(Aei*«(All  A 

AfAll  A  OIAOI  - 

A(A1|  A  0(911 

•(791- 

8(A01  A 

A( 91 1  A  01901 

A  Alim  A  0(911 

-  AI2I  A  0(011 

0(7AI- 

AlAll  A 

•(SOI  A  AlAOl 

A  n(911  -  A(AOt 

A  OIAOI 

0(771- 

A(901A  0(901  -  A(2l  A 

N(*01 

•(701- 

A(A01  A 

•  ISRl 

C  CALCULATF  TMA  OAIVOMINATO*  AMR  CHFC»  STAiJLITv 

»  At^*}  -f**?  •  «♦??)  -  akiai  •  aitm 

frfRMOM  Atn 

AIR  01  A|-  A(71  |•AI1'A|-llf  Tn)»AITl|-^n  1  )•«  |  7?  | -AC  t  7)  •A  (  7A  |  .R  (  7  ••«  I  T4  ) 

1  •AKiAt*R(7Rt.Ai r;i 

Of  N  (•-At  71  lAAl  71  |-M|7«1»A|77»-«I1  t  1 7A|-AK  I  7)  •«<  I  74  f .R  (  1  0|  •*!  T7  | 

1  ••I79t-»«f  F|*Mf7«t>*<KtAt*Af77|«AI  741 
0A«  Df«l  •  nill»*nitl/RllR| 
inOAl  9int  920*  All 

All  OI7|«-OI71l«AiT2|A«f9fl|AAf79IHIf  10 lAMITAl-Of  7914111  If  lAAfTAl'-AfARl 

l*8f79l-A«f71*0|77»A«l9»*0j7l|| 

Of  Ota  0171  l•AI79^-0f  A0lHlf74f4Oll0|»O|7«»»Of77)4«|  n  »»0|7»1 
00»  0f7J  -  OfAfARf 11 l/Rf lot 
0C«  0101  -  ROARIIOI/OA 
fOtOCI  920*  920*  Al? 

A12  ni9l»  -«IAO|40f77>  ♦  OllOlAOfTAl 
17101911  920#  920«  A19 
A19  00*  DIAl  -  nf9|AO(101/OA 

07«  oa  -  oo*oA/or 
|7|0ei  920*  92n«  AlA 
AlA  07«  00  -  D<9lA0C/nr 
17(071  920*  920*  A19 
A19  N9a  N9  ♦  1 

C  HAVE  7N0ur.H  STAALF  OOfOTS  07rw  FVAWINrn 

I7IN9  -  Nt9((All  AlA*  700*  700 

C  CAtCUtAT7  TM7  OAMOMIOaTOO  AT  7ArM  r»rOf«7t»fy*  WA(M| 

AlA  00  A»0  (al *  11 

A20  ARI I laRl I |«A(10|ar>( r  1 faAf 1 1 | ari i«7|4A( T71AO| fafiaAflAiaor laAl 
DO  A90  Mai,  WN 

OCIla  AOIll  a  An(t|a«(M*2laA0( A|aM(M,9|aA0(7|AM|M*4l4A0tA)#M(M.91 
1  aaOl  1 1  latiIM.Al 

0CL2a  MAIMla|A0l2l*AR(A|A«|M*2|7A*MAlA«|M*9l4ACl01A«|M*«laAR(10|A 

1  «(M*91t 

A90  OfL'Mfa  oeLlaA2  ♦  OeL2AA2 

C  calculate  THf  STvrOAL  mean  square  values  OE  TmF  system  VAOIAOLE* 

A9A  r(«*l*lla  ll|7fl|.AK(AlAMf01|.A(All 

ri9*l*l !■  -AIA1  lani 7n|aal7l |.AK(AiaMf«0|.AK|7|aM(Al 1 
riA*l*lla  -AlAOiaOl 70|.AIA1 1AA|71 | 

•  A«Xt  • 


ciiti *ii>  » 

-8i*ot*ef«ni 

Cl*»l*2l«  *1*1 |•BI70|♦*f*0)♦*R(*l•MI«1t 

Cl5*l*2t«  A(*OI*«l 70I«AI«1 l•8lTil♦AR|8l•«ilA|♦»t)l)•*KI7| 
Cl  A* I (2  I*  *l*flI»8|71|#*«IT»»A«*ni*«|*|» 

C(l*l*2»>  BnOI*8l3tl*B(*ni 

CI2»]»2}o 

*•1 

CAli  SI6HA 

triKt  too.  inn.  *** 

4*4  ci**2.ic  Aiin*ni70i«Ai)oi.n(2t**i*it 

Cl  1.2.110  *iin;«Rnot4*i3i  l•nl71l♦n|7tl>nlAnt♦Atll)•«lAll 
Cl 4.2.110  Ai30i«ni't l♦nllnt•nlAl >♦8111 l■nl4A1 
CI1.2.1IO  tnnioBiA.ii 
Cl*. 2. 2)0  Bim>ni2)«n(iiii-A(2i 

CI1.2.2IO  •At?>»B>70i.Bj7n-nni>»ni4ii-ni*  •Bnni 

CI4.2.2IO  -*i2>*4l7tl-niin)*4l11»-4||l»»«ls  i| 

CI3.2.2I«.  I*'! 

*•2 

CALL  SrOKA 

ir (K I  too.  inn.  444 

444  DO  410  lot.* 

Cll. 3.110  U04<'it4l*2.1>  -  Clt«2.1«l> 

410  Cll. 3. 21-  L*i4C  >♦1.2.2  -  Cll^2.1.2l 

r-l 

CALL  SIG»** 
triRl  too.  300.  414 
494  DO  411  to  1*4 

Cll.4,n.  0142. 2.1» 

499  CII.4.2IO  Cll.2*2(2> 

Ka* 

'■ALL  .11  OKA 

jrjKt  ton.  inn,  4it 

C  CACULATC  "Mir  *'1»**IC’’'4S  WHICH  VABV  WITH  AKIKt 

49B  ni40)a  BI2I  ♦  *I3II4*KI*I 

8141 1  a  AI10|aAKIA|aAIM|-AI*l  |ani2|4*l91)a*K(''| 

81421  a  -AKI ll-A 1*0 1481 2 >♦*! 30 >•**1714*1 31 >•*1*1 1*4111: 
81431*  AIIOIaAl M  >*8l41>**l*0l*nill I**!*! |*4R 1 1 ) 

Bl44>a  A|3n>*Bl4r.>-AIA0)***ll  > 

B{49>-  Al41l«ni2l*AKI6l 

BI4«)a  AI40>*8l2>**l41>*aill)*«K|7|.«f2>o*K|*| 
nr47|«  AI4n>«8ni  I-AI41  >•*1(11  |♦l••A|>)••Kt7| 

8(4t>a  -*l*0>4AKn  )*4|4n>.*(7> 

8|44>a  -A(2>an)4n> 

C  CALCULATf  HORF  MfAN  10UARF  VALUES 

494  C(7.1,l>aBl4n>a8(7n> 

CI7*9.2>a  BI41>  aBl20> 

00  4*0  t*  3.* 

Ila  4*  "  I 

Cl  l,i.l>*l*i(|4|*nni>  .Blll.u  (•niJOl 
It-  101  -  I 

4*0  CIT.1.2>a|AIC|4>«8i  tl>  ♦  Blllali  >*<1(9nt 
CI2.1.1>a  AK|4>*n(44>  •8(2nt 

CI2.1.2<>  AR(4>*8(44|  •A|7n> 

K-l 

CALL  IffiH* 
iriK>  iD,  inn,  4*4 


/h\. 


1.1T 


f\  r> 


DO  4*9  r>i •« 

4«9  Cl c; 

CALL  StOMA 
iriRt  tOOt  100*  4AA 
*44  41401  *Ri2l) 

CIT,T,2|«  Bi*)!  •9(23) 

00  4ifl  *■  a,A 
!!•  •*  -  I 

Ct  ItT,l|.(ARI«l*4(  tn«0lll«ll  t«A|>11 

ll>  101  -  I 

470  r(|»7»2|aUKIA|«Oint«A|ll^t| 

CI2*7«lt«  AR|S|4A|44t  ••(?ll 

CI2*7«2>a  ARIS|*II|«4|  •0(?lt 
R-T 

CALL  StOMA 
triRl  lOOt  )00t  474 
474  DO  475  fl  ,4 

Cll*l*lt>  Clt«U7«lt 
479  cn«t«iia  Cl  i«i  a?*;  t 
R«0 

CALL  Sir,MA 

I7|R»  irO»  474 

TMf  RCMAININ6  M^aN  SXlAOf  VALUf*>  A»f  CALCUL4»^»f>  CI«L»  t*  » 

HAS  Ofrii  rOlMO 
474  CI7»4alt«  AR(2t 

Cf7f4«2l*  ARI2|*Af4tt 
00  400  1*1 *4 

Cll*4»nu  AR<S|4C(f4l«l»ll  ♦  ARl2t»C(t»t»l|  -  CITtS»ll 

440  Clt*9tr««  ARI3}*C(  |♦l>t(>l|  ♦  4Xt2t*C«l*lt2>  -  ri|*1»2| 

R>« 

CALL  StOMA 

441  Cf7tlO*l|a  41401 
CI4*10*l|a  0170)40(40)^14]) 

Ct 9t 10*1 )•  0(71 |tOI 40)40 1 70)40(41 (40(47) 

C(44l0*l)4  0(71 )4«  (41 )40(70|4"|42 (40(44) 

CISflOtl )•  0(71)40(42)40(70)40(49)40(44) 

Cl  2* 10* 1)4  0(71)44(49)40170)40(441 
C(ltlO*l)4  0171)40(44) 

C(>'*t042)4  4(49) 

CIS4]0*2t>  0(7ei4r(49)40(4S) 

CI94l042)4  (I(71)44(44)40(70>40|4S)*9(47) 

C(«4l042)4  S(71)4B(4S)40(7e)40(47)40(40) 

C(.9*10»2)4  0(71 ) 40 (47)40(70)40(40)40(44) 

C(2tlOt2)4  0(71 )40( 40)44 (70)40 (44) 

C(1*10»2)4  0(71)40(44) 

RalO 

CALL  St(;MA 

404  "K>  440  l«l,4  r 

C(r*ti*ii«  C(f4i,ui)  v>\C' 

440  Cl  1.11 17>-  C(  141.1,2) 

R-11  ■  . 

CALL  916HA  t  t 

444  DO  449  la2,9 

C(I.17.I)4  Clt4l,2tl) 

449  r().12.2)«  r(t4l,2«?) 

R»l? 

CAIL  SIGMA 


A.IS  - 


c  STAur  Tnr  v«Lur«;  fO»  rnr  Nr»  minimi'* 

DO  iio  r«i.i2 

990  SICMIlt-  StAKti 
AJ«0 

00  9«fl  J-UI 

tflAMtJ}  -  AJI  56ft»  9*Pt  9S9 
999  AJ»  HJttfJi 
UO  COWTtAtW? 

AJMa  AJ 

00  970  !•  li« 

970  ARMfri*  AK(tl 

C  AAINT  TMf  ¥ALUr<  fO»  TMf 

PAINT  ftOOt  N«t  AJM*  (ACIII*  I*  I.***! 

600  PONNATI  5»3MN7"  16*  9XAHAJW-  FI  7.6.  ,'9»  7«<  ll-A  I  •  9X9ri7#*» 

PRINT  AlOt  Nl,  IMGMIJW  ••  UI2I 

610  FOttMATI  SHN}a|6«)K6HSrA7A-FI0«4*4X6HSIGTA«f  10»At6H»H9|r-7r>Fir),4» 

UX6KSIGT0-E  I  j.4t4X6H9!;GSR«ei0.4«4X6H4ir,lF«C  tO*4»/14l6H9lORP«F10.4« 
1  *X6>4ilCdr>Fin.4*4XAHSI62l>F10^o*4X{H4;|r.n«Fin.4*4X6MSIu7V«F10.4, 
14X6HSIGTV«eiO»4| 

PRINT  670*  lAJRtfl*  !•  ]•«) 

620  FOftNAT(9XlOHAJRi 1-61  tFl4«4//) 

C  CONTINUf  TMF  9FARCN 

GO  TO  900 
700  CONTiNtJf 

C  FINAL  PRINTOUT  -  USED  MOSTLY  FOR  oeAUGGING 

600  PRINT  601*  lAID*  !•  !•  loot 
PRINT  601*  ISni*  !•  1*  loot 

PRINT  6OI*lit0(llH2tt9|*  1 1»  t  «t  Oi  *  I  >•!  •UU I  I’l  •?> 

PRINT  601*  (01  It*  laltlOl  • 

P*(JRT  601*  OAePO.OCtOnoOE.OF 
PRINT  601,  («Mtt*  !•  l,llt 
PRINT  601,  (ACIIt,  |•1l•10| 

PRINT  601,  (SIGXIII,  l•l,17t 
PRINT  601,  (ARID,  I«1,PI 
PRINT  601*  (WAIKI,  M«t,  MNi 
PRINT  601*  IIW(H*NI*  M«>1*RNI,  N«7,6I 

601  FORMAT! 1H0/(10F19, 911 
PRINT  607,  AJM,  K 

802  FORhaTIIHO/  e20,9*  19  > 

GO  TO  lOOO 
POO  PRINT  "'ll,  NLOOP 

POl  FORMATI lM010XI6*40Mni SCAROFn  VALUFS,  9Far;m  STOPPFH,  » 

60  TO  700 
1000  CONTINUF 

1100  CALL  rxir 

FNO 


•  A.19 


’!■  f 


r'\ 


f  suPSOu'^’jNr  usFn  aiTw  thi«.  pponR*M 

SUBROUTINE  SIGM* 

*  LIST 

dimension  C<10tl2.2).»(100».*Cn0)«''Trxn?>*PANlC(«,ini.AJRfP). 

1  ACC  1 1 0 !  »dfl  1 1  on )  ♦«  t  ino,6 1  »«<*  1 1  no  )  .HI  i )  .adiiii 

COMMON  IC.FTA21  ,t  T  A2  2  ,  A  JM  .c  .  A  ,  S  I  Gx  ,RANK,AJP,AC.ACC,DPL»MN,W.Wft,H,&'' 

1  f  N  I P  ,  I  A 

C  v''ALCULATF  THF  M'^AN  SOUART  VALUE  'N  EACH  'A*-- 

DO  inO  I»  1.  7 

lor  AC(l-*-3t»  ''TA?i*(C  1  I  .<c,  1  i  +  Ai  Ai*r  1 1*1  ,ic,  1  )'*’A : ->)  *r  I  .  1  1 

I  )  ♦F'^A2  2»  I  r(I.X.?>>A|Oi*r(i*1,K.2l4a!14*»^M  +  ’.X.X'.  i 
AC  (2)-  rTA21*AI7)»'-(l,(t;,l)+‘^TA22«A(l4)»'‘ll,K,2) 

ACf3>-  ETA?1«I  A  I  7  )  *r  (  2,<  .  1  I +A  I  A  I ‘E  (1  ,  1  n-^E  A  • 

II  A 1 14 ) *ci 2,n,2 )  +  Ai p )  •Cl  1  ,<  ,2 n 

DO  2Cn  M=1 ,MN 

Cl«  AC|?)*W|M»2)-»AC|5»*W|M,3j  ♦ACl7)*W|M»A>*Ar|0)*WIM,A) 

C2«  wA(M)*!ACI2)*ACl4)*W<M,2)+ACIf)*M[M»X>4AriA)*W|M,4)*Ari1'1)* 

1  WIM.S} 1 

20n  h(mj,  ; Cl • *?4C2 *•2 » /del  I m 1 
SIGX  IK  )  ■  HI  n*WA  (  I  ) 

DO  210  M.2.MN 

210  SlGXIKI-  S  1G» I K  )♦ I  HI M-1  >4H |HI  , • I Wa I M»-WA |M-I  )  ) 

Sir,XIK;«  SIGXIK)  /3,141AR 

C  calculate  AJ  for  the  EIpsT  »  MEAN  SOUAPr  VALUES 

2S0  IFIK-S)  260»  260.  AOO 
260  DO  300  IR»  2.  NIR 
IR-IR 

irmANKlK.lR)  -  SIGXIKH  300.  310.  310 
300  CONTINUE 
101  K»n 

GO  TO  400 
11"  AIR*  IR 

AJRIKI-  air-7, -MSI  gx  IK) -Rank  IK, IR-lM/lR»NK|r, IP) -rank  IK, lO-lt) 

C  IF  THIS  value  Oe  AJ  IS  LESS  THAN  ThE  PREVIOUS  MINIMUM,  CONTTNUE  The 

C  CALCULATIONS,  otherwise  nrTFPMINf  A  NEw  SET  OF  CONTROL  PAPAMETce, 

IEIAJR(K)/AJM  -  ACCIIA))  *00,  101.  101 
400  RETURN 
END 


-  A. 20  - 


Best  Available  Copy 


